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Introduction 



v ommun \ ty-based educational proqrams are the con- 
cern of many Kxti'nsion and other professionals. 
Emphasis ts un'riMsinqly being placed upon in-depth 
and tm «m i cM planning, »i mp lemon t a t iofc, and evaluation 
ot such programs, thus increasing their quality and 
i-oiiMtujuon t ly the .impact on consumers in the community, 

Ext ens ion and ot her oommun i ty profess iona Is need 
to he very specific in their objectives., They must 
know what resources are nelftted at what time, and from 
what sources these resources are available. They 
should be aware of the management aspect of program 
planning when involved not only in the teaching, but 
also in the planning, implementation, and evaluation 
ot such projects 'or programs. 

Designing, implementing, and evaluating educa- 
tional efforts in the community needs innovative 
thinking, planning, and foresight. Programs are not 
developed m a vacuum; they need the involvement of 
people to make them work. This manual is based .upon 
the experience derived from a project involving a 
cadre of people: professionals, studept interns, and 
advisory committee members who so generously gave of 
their time to the projegt. % 

The^projeet, "Helping Families Adjust to Economic 
Change," was a federally funded project conducted by 
the Cooperative Extension Service of Cook Coll e ge\ 
Rutgers University, in Sayreville, New Brunswick, and 
Perth Amboy, New Jersey, from U976-79, The project 
involved one full-time and three part-time profes- 
y stonals, and part-time graduate and undergraduate 

students. The work that w.ia done included the design, 
implementation, and administration of an educational 
outreach program in family financial management, and 
the development of educational materials on the con- 
sumer and professional levels, A report regarding 
this project is available upon request at a -small cost 
Inquiries should be addressed to Denise M.f-Matejic, 
Department of Home Economics, P.O. Box 231, Cook Col- 
lege, Rutgers University, New Brunswick, New Jersey 
0890 J . ^ *' 

Personal experience cannot be the only component 
of a manual such as 'this. One also applies knowledge 
gained from other .academic endeavors, as weir 1 as from 
professionals in the field, either through their books, 
discussions with them, or in-service education programs 

^ - ^ 
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or lectures. Therefore, the thoughts expressed here 1 
Include all of the above. The authors' viewpoints 
should not be taken as mandate, buf aro intended to 
stimulate turther thinking on the part of the reader, 
Lt is in this context that t he reader should under- 
stand the recommendat ions made by t he authors. It 
also needs to be noted that what worked in one county 
in one state might not be entirely applicable to 
another reijion without appropriate adaptation. 1 



Similar to most eiiue.it i ona I efforts, community- 
based educational programs are open systems. The 
boundaries tit such programs tend to be not weVl de- < 
fined. Their effectiveness depends on their capacity 
in makimj timeLy adjustments to the changing needs of 
the communities in which they serve (Banathy, 1973). 

The deve lopmen t a L p rocess of a commun i ty -based 
educational program is influenced by the complexity 
of ( he program. Five phases h^ve been found to be 
essential in developing a viable proqram: (1) com- 
mun 1 1 y and clientele* analysis, (2) objective setting, 
{ \) program design, (4) program implementation, and 
( r i ) proqram eva luat ion . 

Although there seems to be a loqical sequence, in 
implement inq the aforementioned phases, proqram initi- 
ators /deve I Qpe rs o f ten find that the steps are inter- 
dependent. Decisions and actions taken on one step/ 
phase most likely will have an influence on the others. 
For exampje, althouqh "community and clientele analysis" 
seems to be a loqical beginning step, we have found' 
that objectives often need to be set in order to de- 
lineate a parameter within which community and clien- 
tele analysis can be, properly focused. Otherwise 
human as well as material resources may be utilized 
unproduet i ve ly . . Furthermore, decisions with regard 
to "objective setting" have direct influence on any 
one of the other three steps/phases , namely program 
design, implementation, and evaluation. 

this i nt erdependency among the five phases demands 
a perceptive program initiator/director who is capable 
of viewing each program doeis ior^ f rom the standpoint 
of the entire project. A creative program director, 
therefore, needs to be ablfc^o think and work, with 
project staff from various perspectives. Individual 
staff members must cooperatively de 1 iberate , 'develop 
strategies, and implement program decisions with re- 
gard to o.^ph of the five steps/phases under the leader- 
ship of the director frnm nfrirj^ to finish. 

Program development 4:an be divided into several 
phases. Diagram A will enable you to visualize a 
systematic approach to program development and -provides 
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DIAGRAM A 

THE INTERRELATIONSHIPS BETWKKN COMMUNITY -BASED 
EDUCATIONAL PROGRAM DEVELOPMENT PHASES * 




COMMUNITY SERVED 



COMMUN ITY 
6. CLIENTELE 
ANALYSIS 
Assess Needs 
& Problems 



PROGRAM EVALUATION 
Make Data-Based 
Improvement And Be 
Accountable 





OBJECTIVE SETTING 
Analyze Resources and 
Develop Preliminary, , 
Plan of Action 



ROGRAM IMPLEMENTATION 
/ .Take Action 
Carry Out Program 



PROGRAM DESIGN 
Develop Instructional/ 
Plan of Action 




Boundaries of environment 
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a vivui illustration of the complex interrelationships 
between the five phases. A short discussion follows 
to provido a point of clarification on p^ch phase. 

The five strategic phases in proqram development* 
include (iffe chart on precedinq f>age) : 

1. Ana \%7. nuj the co mmu nity and cl i en telo, which means 
assessing t he needs of people and analyzinq their 
problems. Bo sure you have ^identified problems 
which can be dealt with within the resources of 
your orqan i za t ion , 

You wi 11 need data about: 

--people in the community.* ^ 
--society in general (national trends, issues, 
-etc. ) . 

--you* orqani /.at ion so that you can establish 
pr oq ram limits. 

, y . Analyzing available resources and setting .realis- 
t ic jo^'l. 3 at^d oh joc t i ves . This involves looking 
at present programs, conducted in the community 
(by your organization as we 1 L as other agencies) 
so that no duplication will* result. 

It involves analyzing your available resources 
ol time, energy, and money, and bringing them 
in line with what you want to achieve. ' , 

You need to specify what the desired outcome is 
ot what you arc planning to do, and then set 
objectives which will help you reach this desired 
out come . * * 

The next step is to put the objectives in a 
logical sequence t o reach your qoa 1 . .Remain 
t lexible, and check yourself to see if the 
* goals are really obtainable (e.g., is it 
reasonable to assume that the action you sug- 
gest people take will really be taken) and 
meaningful to the majority of people you intend 
t o se r vo , ■ - 



Overall concept based" on an*l< adapted from Figure 1, 
The Extefision Teaching or -Program Development Cycle, 
Chapter II, "revaluation in Extension Education," by 
J. Neil Kaudabaugh in the U.S. P. A. publication, ^ 
V. va I ua t j_on i n . Fix t ens i on , Division of Extension 
Keseaicl) and training, federal Extension Service. 
Additional input from several Cooperative Extension 
in-.uMVice provji.ins conducted in New Jersey. (See 
also reteronoe pace.) 
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P^Aj^I^jA^otjra* a i}d_d_eveJ_o^)nH| .in instruct icm.il 
f 1 '!".^ .._4?t.ion. T-he subject m«tTerT)T~y our 
teaching needs to be delineated and defincvd. 
Lessons neetl to be outlined, resources selected, 
and an instructional plan of action developed. 

Ask yourself what .needs to be discussed, what 
information participants must have and in what 
sequence, and how uart ieipahts will' be involved 
ami made to feel (■Sponsible 'f6r their own learn- 
ing. Look into thTr*v«rious methods of teaching, 
e.g., mass media, meetings, through mail, work-' 
shops, one-to-one basis, direct teaching, through 
other resources, etc 

Ask yourself what materials will be needed to 
accomplish your goals and who will prepare them, 
study teach inq aids- available and see which ones 
would be appropriate and affordable. 

This manual uses- the topic of financial management 
i as its program focus. "Refer to Personal a nd 
^\ > ELiv.J:'JJiailces--A Resource Guide For Teaching * 
tor detailed coveraqe of this topic. othoV topics 
of community education could be used in your pro- 
gram development work. 

Implement i rig the program. Now you need to set' your 
instructional methods in an order of priority ac- 1 
eorVUnq to resources available, "title limitations, 
and/or gther Constraints. Some of the tasks in- 
cluded In this phase are organ izin« yourself*, 
qettinq space, developing a time sfchedul'e and 
working calendar, and implementing your teaching 
in community buildings, via radio, in classrooms, 1 
homes, etc. In short, carry out your plan of ac- ' 
t ion . 

^^i^iD2_?L f ?iLil!: o 4l ram - Your programs are success- 
ful when you can show that your plan of action has 
allowed your goals to be achieved. s , This can be 
done through proper evaluation. Controls need 
to be set up at intervals to morri tor the Progress 
of your program. It is important to pj^fn your 
evaluation within each of the program phases, and 
to make it an integral part of your program. This 
may require additional huma/i and financial re- 
sources; '|Bjut it is well worth the effort. ' 



Areas to be evaluated can include: 



1 



Input: Needs assessment done, how you 

c*ame about designing the program, 
who was involved in planning; etc, 
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Process and Output : Your iriplemen tat ion , 
* methods used, how well 3one, how 

* appropriate for your clientele, V 

etc. 

• * • 

Product: What was developed during the 
pro jec}: (educational materials , 
hpme-study course, handbook, etc.), 
materials used . 

Impact : Behavioral changes accomplished : 
what have participants ^earned, 
become aware of, or done to im- 
* prove their own situation because 

of your teaching. 

Sometimes only an -impact evaluation might be war* 
ranted, as in the case of ongoing programs where 
individuals ^undergo strict performance evaluation 
on a yearly or bi-yearly b^sis and programs are 
planned and objectives chosen ahead of time on a 
^ yearly basis. This planning is part of the 

structure of the organizat ion and involves grass ^ 
roots participation by learners. * 

At other times an overall project Evaluation will 
be needed (e.g., when conducting b special project) 
This type of accountability will carry benefits 
for the entire proje'ct and f6r future progtams of 
other educators who can base their activities on 
your repor ted results* 

A type of evaluation increasingly in demand, but. 
difficult to accomplish, is an analysis of programs 
on a cost-benefit basis. This means that various 
.teaching methods would be analyzed as to time and 
money expended against the results desired. De- 
cisions as to which methods offer the greatest cost 
benefit would contribqte to future program planning 

Based On the evaluation (however informal) , you 
should see if changes in strategy need to be made 
such as setting new goals, modifying theip or making 
np changes. This re-examination should be- done for 
as long as the program or project is in force, and 
includes the teacher, administrator, evaluator, partic- 
ipant (s) , member (s) of advisory committee, etc. 

This introduction vhas been prepared to aid pro- 
fessional educators in the task of planning, implement- 
ing, and evaluating community outreach programs. Most 
of the information contained l%eijein was developed and 
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gleaned from just such a program--"Helping Families 
Adjust to Economic Change," funded, by the United 
states Department. of Agriculture through the Co- 
operative Extension Service, Department of Home 
Economics. Cook College, Rutgers University. In' 
short, the principles and" suggest ions presented 
jn. this manual have been tried and tested. They 

vm,!" 1 t,U> rt0 ' ,>V, UN * m - W,< ^ >0 th °V w i ! 1 wJrk 



7 iJ 



Chapter 1 : 

NEEDS ASSESSMENT 
AND OBJECTIVE SETTING 



( 
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* GENfcRAL NEEDS ASSESSMENT 

There is a general: lack of awareness anti knowledge 

of consumer aoncepts in today's marketplace . The many 

surveys .done pecently by research and ^ht'vey firms doc- 
umerit this abundctfi t ly . » 

Tt\e technology in the marketplace Ls complex and 
is becoming even more -so. American consumers have more 
choices available to them than ever before. On the 
average, they are exposed to approximately 1600 ad- 
vertisements a day', pullinq them in various directions 
of thouqht and action. 

Government requlations are becominq 'increasingly " 
manifold as well as complicated. There is abundant v 
consumer leqislation available protect inq the irt- ' 'vjjj^ 
terested, knowledgeable, and motivated person*. Yet 
many people, who could benefit from knowing.about 
specific consumer rights, and responsibilities in order 
to live a mor$ meaningful l^ife, are not aware of what 
is available and what laws e*ist to protect them, 

Socioloqical factors influence the management of 
resources of individuals and families, ^4any different 
family life-styles are acceptable in today's society 
and practiced openly today. These include, in addition 
to the traditional nuclear family, the sinqle career 
per&on — widow—divorced person; the couple without 
children; the couple with grown children; the "re- 
st ructured' 1 f ami ly (meaning the family where One or 
both spouses have previously been divorced, have 
remarried and now have small or grown children from 
either one or two different sets of parents); the 
single adult who chooses to adopt a child; and the 
sinqle mother (or father), either single by choice or 
after .death. Sociologists say that never in history 
have so many people lived throuqh so many various 
Hfe-styles at one time or another in their lives. 

There is also a sociological upheaval of increased 
divorces and greater permissiveness, as well as flex- 
ibility in life-styles; a. rise, in the individualism 
of people in general; and a greater independence of 
women and children in particular, which is a decided 
change from the patriarchal society where the husband/ 
father made most of the decisions. 

11 
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* All ot the above points to an increased need for 
people of, all aqes , incomes, ^ackqrounds,, ethnixrity 
or family structure to qet trfe most put of their 
• dollars and to make the effective manaqement of their 
iVsoiiM'fs a lifetime affair. 



OWfU'NlTY NKKDS ASSKKSMKVT • ; / 

tVnsumex eduea t o xV need li^bo mor e Specific in thei 
assi v;-;miMi t ot problems in the cftitimunity. They should 
desian and conduct *i comma n 1 1 y Heeds* assessment to 
bct*tei imdei st andj t he .pocyple* in the contiruin i t y . The 
aieas e! -neatest concern -should he pinpointed within 
tlH 1 an id.- lines ot qonerA\ objectives of the school. 
•;t I'm, .'i^i.Miry , *ot otftor orqan i z«\t ion s*ponsorin<] thf* 



Till' k'lMii.y Ptooess and t he Publics We Serve" ■ 

Im . 1. »L. ^H'iu>/ IM^fi'SsiM and Head of Adult 
ana * '. 'r.nnru m\ * \'o 1 I eqe ilduoation at North Carolina- 
St ite I : n i vo x s l t y , recent ly saul that as people's 
needs increase tapidly a fid economic circumstances 
che^ie, eduVators w i I 1 need t o qot increasinqly in- - 
vaolved in now proqrams (e.u., enerqy conservation), 
and will therefore need to sharpen their skills to 
i dent it y taraet audiences and 'direct proqrams to 
v t hem , »i nst .\ui ef lust to the qene^al public. One 
way to accomplish this is throuqh exist inq social * . 
axeup> in the eoimminaty. 

(VcciMd. irja to Or ^ Boone, when work inq in the com- 
m.im t\ tlneuah its leaders* and with the exist inq 
pnvvi stiuvture and q roups, vo need to think in * N 

t * k t !*vs c ! t eui "concept s : 

* 

Social s t i at l f i cat iY>n s and Social differentiation 

Pouei meed tor loo*; iiuiVit l n t oxma 1 leaders;* 
these axe the power ( uiiuosjiwho really* make 

t he i<re i s i er s ) * ' 



* Acs *s *w ! « s :- 'erse:- 1 aces i o Px . !Ux»:»r \* K eso in-service ed- 
a^at i/ n : : oei e-\s ! t^r Home cookc^u cs Popartnonts of the 
New /er s^y Cooperative r.xttnsuMi Sex vice hava served 
as s? i:vuli t ci tho 'needs assessment pox* t ion of this 

e»aal. I! : •■ thoughts aoi c analysed, carried throuoh, 
ird adapt cvl for consumer educators in Extension 
en^tetoh -croqxars by He V v ateiio, 



Culture. 



interfacing (a 
19 72) , meaning 
sots of people 



new concept -that arose around 
t he i nteract ion between jp«r ious 
of different backgrounds. 
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i tuat ion 
oT^ people 
well as 



This means developing an are a (county) 
?l d ^\ m ??t which includes a demographic stud 
UVlngin the areas you are concerned with a 
developing a 1 i^st of major employers and agertcies 
For some of the information, you miqht need tKp as- 
sistance of a demographer , the library, the planning 
board, etc. Other information can be obtained from 
county and resource guides; brainstorming with some 
of your identified community leaders and consumers 
might also bring good results. 

?5K!ii**fc* on (personal characteristics you 

are looking Tor in~your clientele): 

income (low, high, middle) 
educat ion 

employment (private, public) 
age d i s t r i bu* ior* of population 
number of people in the area you will serve 
race 

ethnic background 
number of househo Ids 
hous i ng ; qua 1 i ty of ho lib i ruj 
family structure 



Data on Ins ti tut Tons 



list of formal groups, 
community which employ 
are of a certain size, 
in your community. For example 



in Yo u r Community : Make # 
institutions , etc., in your 
a certain number of people or 
or which simply serve' people . 



industries (size, 
character i st ics) 



imjp] 

type, people 



employed , other 



agencies, schools , col leges* 



newspapers, radio stations, television stations 
associations, clubs 

financial i nst i tut ions * ( banks , savings qlkl loans, 
credit unions) * 

insurance companies, credit counselling services 

• * Si 
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retail t ab i i sjhmenta ' ^ 

religious i ns t i tut' ions , organ iyat ions % 

labor unions ' , 

civ u* o! gan 1 /at iohs (PTA, I. ions C\ ubs , YWCA, 
t enant s^t gan i zat ions ) 

ronaumn 1 groups 

Ay you dovolo^) your 1 ist , write down any* unique 
> characteristics -about the population or inst i tut ions 
as t hey sur t ace • * * f 

Analyze the informal power structure in the com- 
munity with the help of some person (s)„ interested in 
benefitting the eommunity; search for and identity 
intormal leaders in the community. Make plans on how 
to interest them m your project by finding Aut who 
knows then and how you might approach them-. * 

v . . 

Assessing the Nyeds^of_ Specific Target Aud iences 

Once you *havc done your demographic study ^ in. 
.which you % identified your community ^nd its people; 
its religious, civXc, and political leaders; its 
industry; aqenc ies ; agsoc i a t ions ; and other formal 
institutions; the next step is to takt? all the data* 
you have accumulated and determine your target au- 
dieney(s) by sett i ncj prior i ties and identifying whom 
you need and want to serve the most. 

The following checklist will help you accomplish 
this: 

i . Identify the major goals of the organization 

in* which you work (e,g., undversity, school ft 
agency ) . 

* • 

. Goal #1 
. Goal #2 

^\ ( , Goal #3 * . 

I dent i f y and list major target groups your 
, ' organ i zat ion has a commitment to s^rve , then 

number them according to their priority (if 
applicable); e.g., youth, the elderly, minor- 
ities, women, the handicapped, etc." 
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last t ho top thrno tanjet Audiences you just 
idontitiod on the chart below. Now look hack 
to your demographic study and take thrjH* q roups 
which you tool need special* at tent ion as a re- 
sult ot this study and list them on the chart 
bo 1 ow a h i nd i ca t ed , 



CHAKT I'OR 1. 1 ST INC, TAUGHT AUUlKNCfcS 

Top pi unity tanjet an- Top tai qot \uid i once as 

die/ice:, ot you! oiuani- . taken t i om outcome ot 

,l,, */S denuHjra|>h i c stiuiy 



Conipat o t hose two 1 i sts . Arc t here any q roups 
which ait* the sank 1 in both columns? If so, it 
is an easy matter. It nut , some sottinq ot 
prnM-it n»s will have t o be done aqain and 
sono compiomis*- reached. Most likely, t houqh , 
Y^i will tnuj that there i s over I app i nq and tj^at 
Mil* l.iiqi't audiences wh i <ih need your aid aro^he 
ones \our ot a an i /.at i on (project, school) want to 
■;<m ve 

Needless to say,' this process will only be of 
help to^yeu it you have some flexibility in 
ehoosmu your tarqet qroup. Hut even if you 
don't, ^Liitu'rs ai e that such soul search inq 
will mctease your sensitivity to the' needs. 
■ d y ou i commun i t y , 

Wi i to down vein ( i iu 1 t h i ee Vlio i cos o i t a njcfr 

.iiid icnces, * — ~ 



*e,a., tin- a. red; homemakors ; preschoolers; profession- 
als; low- income families; younq adults; families; 
wt. m n i iM wive:;; vja i n : u 1 1 y employed hompmakers ; mother s ; 
t; » n.; 1 1 ■ patents; n i dd 1 e-y#»a r families; husbands and 
wives; n't ih'J people; widows; people worki*nq in cer- 
tain mdustty, business, or school system; other 
special interest aroups (clubs); women re-enterinu 
t he 1 aboi ma I kot ; etc. 



\ 



Note some characteristics of the three groups 
yo\\ want to reach, '(e.g., age, family struc- 
t'ure, ethnic background, education, recrea- 
tion orientation, changing housing needs ex- 
\ pec ted, care of elderly, reassessment of 
careers J educatidn of .children, physical 
change, Srti justment/ and change in life-style, 
mental adjustment, rereducation *for employment, 
cunt i nuing educat ion needs , nutrition and 
health, etc.) Use the table on the' fol lowing 
page to list these characteristics for your 
three groups. A sample audience is given in 
the first column. 

Additional important questions which might help you 
focus your program planni^j towards specific target 
audiences include: f 

Where can these audiences be reached—where 
do they congregate? (home, church, school, 
job, supermarket, recreational facilities.) 

How can these audiences be reached? (through 
the mass media, newsletters, correspondence 
courses, school, etc.) . 1 

Are they likely to attend classes? 

If your audiences do not attend classes, which 
functions do they attend that would make them 
accessible to your program offerings? 

How ca^'your program offering be presented 
to generate the excitement necessary to get 
thorn to attend? 



CONSUMER SPECIAL NEEDS ASSESSMENT 

Needs as Seen by Ed u cator , 

You have now delineated your target group and its 
characteristics. Now analyze and set priorities re- 
garding its; specific subject matter needs as you see 
them. For example: ^ 
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CONSUMER SPECIAL NEEDS 


ASSESSMENT CHART 






w 

Sample audience 

* 


Your target 
audience 1 


Youir target 
audience 2 

> w- 


Your target 
audience 3 


Identity by 
Name : * 


- , — 

Muidle-years 
Family 35*55 






« 


Character- 
istics , 
interests , 
needs in# 
coitunon 


, Living and 
* adjusting 
to change 




- 


i — ^ — . 


j 

» opt?cicii nucrivion 
needs 

. Financing chil- 
dren's q^ucation 




< 


w 




• Changing housi'hg' 
needs 

. Preparation for 
retirement 






r 




. Children ,away from 
home, etc. 


* 




•* 

• 



A young couple without children will need 
information on proper budgeting techniques 
and credit information to start life to- 
gether on a positive note, both personally 
and financially. * * 
9 

A widow with some funds left by her husband 
will need information on proper savings 
strategies to give h^r the greatest possible 
protection in the years to come. 

A middle-aged couple with children may have 
overextended themselves due to easy access- 
ibility to credit and the use of credit by 
several family members. They will need a 
family spending plan and a workable system 
of money management for the entire family. 
They may also lack!* adequate savings to sup? 
1 port education previously planned for their 

children and may be spending a high amount^ 
of income for transportation if there is 
more vthan one (or two) cars in the family. 

A family with limited financial resources 
mi/jht not have the management ability and 
re/sources to live the way it wants to live. 
Ttt© family's goals and aspirations might be 
x ■' unrealistic as far as needs and wants are 

concerned in relation to resources available. 
The family ma^ also need basic skilly to shop 
in the marketplace and knowledge regarcUng 
how to maximize all its resources: financial, 
human , and community . 

An individual or family with very low income 
might need help with survival skills regarding 
reading, operating in the community (including 
marketing), community resources available, and 
agencies providing services. 

People have different interests and 'levels of ' 
knowledge. You need to pinpoint those interests and J 
tailor your program to their needs. , f 



N eeds as Seen by Target; Group . 

Frequently, consumer educators do not know the 
specific make-up of their audience or the people who 
registered for a program, especially if it was not 
targeted toward a specific group. In this case, find 
out about the interests and personal backgrounds of the 
people in the audience in order tg determine their 
special needs as consumers. 
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The quest lorma i re on pages 20-2) i s another ex- 
tujiple of assessing consumer needs and interests; it 
oaji be easily adapt tul to different subject matters. 
It will -give you a Valuable indication of the interests 
and needs of the group with which you are planning to 
work. Such a gues t 1 onna i re flight also be sent out to 
people on ma 1 1 1 ng lists that y.ou have available, for 
instance, t>ank customers, utility bill recipients, 
etc. The questionnaire should include a ndturn ad~ 
diess ami tho.se loturning it should be maclp aware of 
the functions of your program arid should l||b invited 
t < > pa i t i o 1 pa t e . ^ 
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QUC5TI0NHAI RE* 




L I I 



V . 



vr 



Mfaj 

Ma r ital Stat us : 



Fema le 



Married 

Divorced, separated ' 



Your Aqe 

Aqe of spouse 

Aq e s o t de pe nd e n t children 



Sinqle 
Widowed 



IV . Kmp loyment : 

homemaker 

work mq full t ime 



workinq part time 
unemployed 



a) Your income ranqe: 

$3 - 5, 999 per year 
$6-8, 999 per year 
$9 - M , 999 per year 
° v « r l r >,000 per year 



b) Your total family income ranqe: 



under $10,000 per year 
between $10-14,999 per year 
between $ 1 S~ 19,099 per year 
over $20,000 per year 



Pos i t l on : 

seeretary-e 1 erk 

prof esr> iona 1 

b 1 ue co liar worker 

( factory , etc* ) 
white collar worker 

(sales, etc.) 
other 



A 
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A 



✓ 



VII, Education j 



High School * e «_ No 

Coi lege • Yes % No~ 



2 Years 
4 Years 



other 



If married, who takes care of most financial 
matters? you ^_ spouse/ jointly 

Do you teel you have a well-balanced overall 
financial plan or program, tailored to your 
individual need*?' Yes No 
\ 

How often do you and your family openly discuss 
your financial proqram in a constructive way? 
Sometimes Always Never 

Do you include your children in the planning 
sessions? Sometimes Always Never 




Check any items that apply to you and share with 
us your personal concerns in each of the following 
management areas. I.f you have no concerns in a 
particular area, please state this. 

not enough income 

don't feel 1 manage well enough 

Budgeting lack of communication within family 

t _no definite short-term goals 
no definite long-term goals 

My concerns 



Credit 



^coQld not get credit in my name 

^am overextended 

_don # t understand contracts 



My concerns 



21 



^don't understand different types 
. don 1 ! have -enough protection 
tneurance ^don't feel the. plan is tailored 
to my needs > f 

don't know where, to get reliable 
infprmat ion - 



My concerns 



Sav inijs 



- ■. I „ 

have no fam*^- savinqs 
fra.ve no personal savinqs 

r don't f^N^^^u^aaly 

^ can't savJB^enougn 

have no $avings plan for 

«~~chi ldren 1 s education 



My concerns. 



Do you and your family have more savinqs now than 
three years aqo? 1 Yes No 

Total family savinqs: Under $5, 000 

Over $5,000 ^ 

\ * 

Total personal savinqs: Under $5,000^ 

Over $5,000 



investments 



have no f ami Xy investments 
"don't understand enouqh about 
this area to have made 
personal investments »" 



My concerns 



Housinq 



should 1 rent or buy 

need information on financing a home 
need guidelines on choosing a place 
to Live . 



My concerns 
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I have no will 

Wills will is not up to date 



My concerns 



6. What do you feel is, or has been, your biggest 
prQblem in working out an effective personal 
financial plan? Please be as specific as you 
can in describing any problem you, have, . 



0 



*fhis questionnaire has been developed and us^d by 
Denise Matej ic in purveying educational program 
needs on a regional basis in New Jersey within the 
tegular pr^am activities of Extension. 
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Nee ds Summarized 

Based on the various project ^needfc assessment's 
identified so far, you are ready to develop 0 com- 
munity program. An example, taken from the project 
'"Helping Families Adjust to* Economic Change," is 
given below: <. 

Needs were determined *nd the following j*gree- 
mei>t drawn up between/the Cooperative Extension 
Service, Rutgers— The\ State University of New 
Jersey ; and the ExteuVi° n .Service , USDA: 



PURPOSE: TO DEVELOP A PROGRAM TO HELP FAMILIES 
ADJUST TO ECONOMIC CHANGE AND IMPROVE 
THEIR LEVEL OF LIVING 




Whereas, there is a need to help families understand 

the effects of economic change upon their personal 
economic stability and security, 

Whereas, there is a need to help families determine 
economic goals consistent C/ith their values and 
available resources, 

Whereas, there is a need for families to learn and 
use skills to control and manage money, 

• 

Whereas, there is a need for families to determine,, p 
debt limits and manage debt within those limits, T 

Whereas, there is a need for families to adjust 
spending and credit use as economic and/or 
perspnal change occurs, 

Whereds, there is a need for families and c individuals 
to increase knowledge and skills to extend, ex- 
pand, and increase resources to increase their 
standard of living, 

Whereas, there is need for families to provide proper 
insurance protection at cost adequate to their 
circumstances, \ * 

Whereas, there is a need for families and individuals to 
increase knowledge and skills necessary to extend, 
expand, and increase resources to improve their 
level of 1 1 ving, 

Both the Cooperator and the Service wish to help to 

determine the most desirable program to help families 
adjust to economic change and increase their level of 
living. * 0 
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SETTING AND WRITING OF OBJECTIVES 



You have analyzed your community and assessed the 
needs of your clientele/ Next comes settinq objectives 
and statinq the desired outcome. 4 * 

Proqram object ives must be set and these objectives 
must be put into a sequence that is loqical and meaninq 
ful. By analyzinq your list of objectives, you will 
remain cost -consc ious throuqhout the process of ^esiqn- 
iny and implement inq your proqram. You will also bo 
projecting what will happen, in the project and what 
you expect will be accomplished. Make sure that ydur 
objectives c^in be measured, which means that Indicators 
need to be developed to measure some of the t^Tlowinq:* 

tarqet audience identified (who is to be 
reached) * 

. .how mAny' people are expected to be reached 
(a very difficult projection to make in an 
adult education proqram, Jbut an estimate 
would be worthwhile as it helps later when 
one controls and evaluates the project in 
its various phases) . 

what will be accomplished. 

what will the learner have learned. 

. -what chanqes are expected in the learner, 

what beneficial action miqht be taken by the 
learner because of your proqraip. 

If one concept should be stressed aqain ancWigain, 
it would be the folPbwinq: DO NOT WRITE EDUCATIONAL 
OBJECTIVES in terms of your activities, but in terms 
of what you want learners to learn, understand, or do. 

It does not really matter how much activity and 
"business" there is around a tas-k, it matters what is 
produced. The consumer educator's qoal is to produce 
an informed, knowledqeable , and interested consumer." 



♦More on this topic will be found in the chapter 
on "Evaluation." 
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Research shows that learning takes place in four 
steps : 

1) becoming aware pf and interested in the* , 
* subject matter, 

2) becoming knowledgeable about it, 

in tenia I iz in<j the information, and 

4 ) taking ac t ion (this is the last of the 
steps in learning) • 

As an example, you might state yoUr objectives in the 
following manner:* 

AWARENESS : The learners will become aware of 
the functions of credit bureaus 
f and will be able to recognize 
^those f unct ions when given t© 
them in a list- (Learning at v 
-v recognition level - ) 

KNOWLEDGE: The learners will become knowledge- 
able about different types of life 
insurance and wall be able to list 
the different types available. 
(Learning at recall level.) 

KNOWLEDGE AND INTERNALIZING: The learners will 
re-examine their persdnal financial 
\ plan. (The learning begins to be- 

come meaningful to the learner.) * 

ACTION: The learners will become motivated 
to take financial inventory once a 
year or whenever appropriate to * 
their personal situation. (The 
learning h^s become so meaningful 
that a behavioral pattern has been 
formed, ) 

The e\ample given below will show you how objec- 
tives were set in the project "Helping Families Adjust 
to Economic Change" and might give you some ideas for 
writing your own. 

* For more information on the topic of writing objec- 
tives, consult Robert F. Mager , Preparing Instruc- 
tional Objectives , Fearon Publishers, 6 Davis Drive, 
Belmont , Cali fornia , 94002. 
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Objectives .of "Helping Families , 
~~ Adjust to Economic Change * 

Individuals and families will:* 

--Understand that* personal economic competence 
is one of the major components in achieving 
the quality of Life to which each individual 
aspires; ' 

* ■ 

--understand the effects of economic cfvanges 
v "Upon their personal economic stability and 
security, and lear,n 4 how to adjust accordingly? 

--determine economic goals, consistent^ with th£ir 
values and available resources and take actions 
to achieve those goals; 

--learn and use skills to develop a personal 
money management plan recognizing that 
periodic revision is n'ecessary ckie to 
changes in the life cycle; 

'• 

--understand the concept of consumer credit, 
. its advantages, disadvantages, and wise use; 

--determine debt limits tailored to their own 
sit uat ion ; 

--identify the different types of credit and 
methods of repayment; 

^\ 

--understand contractual obligations and the 
consequences to the consumer if not fulfilled; 

--understand the feunctions of credit bureaus, ' 
the importance of a good credit rating, and 
the consumer's rights and responsibilities 
as far as credit reporting and credit files 
are concerned; j* 

- -under s t and the various types of i nsu ranee 

policies available; . * 1 




* 1 1 should be understood that not all object ives 
cited applied .to al_l consumes reached through 
the project, nor was that an intended outcome; 
these objectives served as an overall framework' 
for the diverse consumers reached. 




*ie4rn how an insurance protection program 
can be adapted to their personal needs and 
at* cost commensurate with their income; 



-understand the role savings and investments 
play- in a family's overall financial wjbII- 
being, and the benefits of saving regularly 
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Chapter 2: 

PROJECT PLANNING; 
AND DEVELOPMENT 
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WHAT IS PROJECT PLANNING* AND DEVELOPMENT? 



Project planning and development must answer the 
questions of who, what, when c where, how, and why. 
The "who>, and "why* questions should have beeh 
adequately answered through your needs assessment. 
This chapter will, concentrate orv finding answers to 
the questions of { iYi the' order in which they appear 
in the chapter) i WHAT, HOW, WHERE, WHEN • But first, 
a few words about the project approach tp 'general. 



DEFINITION AND CHARACTERISTICS OF A PROJECT 4 
Pro ject 

A project is a designed program, functioning some- 
what independently within the overall educational 
administrative guidelines of an existing structure; 
or as Melvin Silverman, author of Project Managemen t 
(The Professional Development Program ), John Wilev and 
Sons, says, A project is an Organization designed to 
accomplish a specific achievement. It is created fjrom 
withyi a functioning parent organization and dissolved 
upon completion of that achievement." 

The concept of project is being used in this . 
chapter in the broadest sense o? the word: from 
a separate entity to an integrated but still sepa- 
rate major task lasting for A limited period of time. 

Project Management 

Project management is the planning , directing, 
and supervising of a specific project. To quote 
Silverman, "project management is the dWectio^ 
and supervision of a project. It is typified by 
the use of specialized control techniques." 

Characteristics of a Project 

* A project is limited in time of operation; 
starting and. ending times are usually decided be- 
forehand. It is limited in scope. The objectives 
and purpose are very clearly delineated; the budget 
is usually closely defined^ the responsibilities 
are spelled out. The evaluation is usually built 
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in and is also very precise in its scope. 

The team which works on a project will disperse 
after it is completed. Even while immersed in the 
planning and implementation of a most successful 
project, the project director, principal investigator, 
project leader, or other titled individual, has to 
think in terms of gradually phasing out the project. 

It is established to achieve a specific purpose, 
and there is a certain flexibility involved in the 
management of a project which the regular ongoing 
program does not have. 

"The pro ject ' d i rector or manager is in charge of 
the entire project in terms of its management f ad- 
ministration, and supervision of his or her team of 
professionals, employees, extern afid intern students, 
volunteers, 4 etc. Administratively, the functional 
manager of the organization is in charge of personnel 
actions. Sometimes these roles are played by one 
person, depending on the organizational structure. 



IMPORTANCE OF PROJECT 
MANAGEMENT IN EDUCATION 

With financial resources becoming increasingly 
scarce in education and the persistence of problems, 
the creation of a special project coordinated by one 
person (perhaps using outside funding) o^an be very 
effective. It can zero in on one special task; it 
can come up with solutions in a relatively short 
period of time without the expenditure of tremendous 
amounts of money which would be necessary if a new 
pro 4 ?} i am were instituted within the parent organization 

With the popularity of seeking outside funding 
from federal, 'State or private sources, the pr/nciples 
of project management should come in handy, as any 
landing agency will want an exact proposal submitted 
to it. This proposal usually includes a situation 
statement, needs assessment, a ket of objectives, a 
plan of action, timetable, «< and a budget. The project 
will stent and end at specified times. One person 
needs to be in charge of jit and has to submit a de- 
tailed report at the end of the project. This person 
has broad responsibilities and duties and multiple 
coordinating functions to fulfill- 




CHARACTERISTICS OF PROJECT MANAGEMENT 
VERSUS FUNCTIONAL MANAGEMENT 

In the traditional functional management, each 
manager is In charge of his or her special functj*>n, 
i.e., sales, purchasing, personnel, field supervision. 
In project management, the project manager is a co- 
ordinator. He or *she works across functional lines, 
i.e., he or she wfculd have a function in sales, pur- 
chasing, personnel, promotion, and field supervision, 
to t^ke an example from the business world. 

In the federal project "He Iping Fami 1 ies Adjust 
to Economic Change- supported through special needs 
funds by the USDA, the project director had the 
function of a purchasing agent or buyer, assisted 
in the hiring of the community coordinator, directed 
the overall project, was responsible for the budget, 

v designed the project, and ovefsaw its implementation. 
The director also {lired the project evaluator; over- 
saw the development of educational materials for 
consumers and professionals; and made sure that the 
fimjl reports, evaluations, and all other elements of 
the contract were fulfilled. Being in charge of the / 
budget, she had to see that the budget was monitored 
regularly and that the project team had enough re- 
sources to function properly. Then she had to co- 
ordinate internal and external relations-- internal 
including the project staff ahd colleagues consisting 
of professionals, students, and secretaries; external 
including agencies, schools, civic clubs, and other 

41 people in the community. In addition,'a very impor- 
tant part of the coordinating function included com- 
munication with superiors such as the department 
chairporfioiv'Virul the dean as well as the County Co- 
operat ifce^ftxtens ion Service professionals. 

Many tijnes within educational institutions there 
ate not enough resources to hire a new functional 
manager or director,' so a specialist is designated 
to conduct a spec i a 1 ' pro ject . 

In recerrt years, we have been hearing more about 
* the management of specific projects in the field of 
education. Examp I es \ are an energy conservation pro- 
lect for* the elderly, projects of the handicapped, a 
consumer education project for low- income families, 
nutrition projects for the eLderly, etc. Federal and 
state government funding for special projects has been 
increasing; on the other hand, the traditional re- 
sources ava i tab le to educat iona 1 i ns t i tut ions * are 
becoming more scarce. experts predict that the number 
of temporarily funded projects will increase. These 
projects will have a specific scope and will start, be 
delivered, and evaluated on their completion. 




As accountability of funds is emphasized, pressure 
Hill continue to be exerted on maximizing resources to 
achieve goals. k 

One reason for the project method is to try out 
something new, innovative, And dating; if it works 
and proves to be worthwhile, it will be included in 
the ongoing process and made a permanent addition 
to the organization. 

The project approach is "also used if the task 
confronted is very complex and needs -a lot of co- 
ordination- As an example, we could cite the Ex;- 
tension Service's Northeast Extension Publications 
project, where one function of the ptojefct manager 
is to oversee the development, production, and dis- 
semination of Extension consumer education publica- 
tions from all the states in the* Northeast, 

The project method offers tremendous opportunities 
to experiment at relatively littjLe Cost, Educationally 
speaking, it is a great chance for an "intellectual 
entrepreneur " to be able to move into Uncharted waters. 

Experience gained through the federal project on 
which this manual is based shows that one of the very 
important tasks is that of communicating among project 
members on an ongoing basis. Difficulties can and 
most likely will occur regarding maximization of 
personnel efforts, because the goals, ( insights, and 
background of permanent staff, part-time professionals, 
para-professionals or iruterns, office workers and 
regular staff and administrators outside the project 
might be divergent. 

Special effort needs to be made to clarify again 
and again the goals of the organization and the pro- 
ject: the strategies to be, followed and benefits to 
be jlerived by consumers as well as the project team 
from the project. Similar communication should ideally 
be going on with administrators and professionals in 
regular programs to make them understand your goals 
and objectives. 

One final thought: to operate most efficiently 
you need to have freedom to experiment, change strat- < 
egies if necessary, and to make mistakes. Secure the 
complete trust and cooperation of your supervisor and 
strive for mutual understanding^ 
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PROJECT DIRECTOR; RESPONSIBILITIES 
AND CHARACTERISTICS 

Plana what heeds to be done and when; designs < 
project, writes proposals,, submits for funding. 

Administers and/or supervises the use of the 
funds. 

Hires, or assists functional manager in hiring, 
perspnnel fpaid as well as volunteers); co- 
ordinates their activities ; supervises them* 

v 

Directs project (oversees all phases of project); 
if applicable, work^ on project alone with no 
teAm involved. 

Sees that resources are available for project 
act ivi tiies and supplies what is needed. 

Coordinates evaluation or directs evaluation as 
applicable; monitors the project's progress. 

Plans and implements phase-out of the project;^ 

has interest pf entire team at heart. 

c 

Needs tp be creative and innovative, have 
management background, be able to coordinate 
arjd delegate tasks, have human relations and 
motivational skills. 



WHAT DETERMINES THE SUCCESS OF A PROJECT 

Experience gained from the USDA-funded project 
indicate that the following factors determine the 
success of a project: ' 

. A thorough and efficient planning process, 

Enough flexibi litY to b^ able to change strategy, 
if necessary. 

Starting the project on time. 

Completing the project within the sti^pulated 
time and within the stipulated budget. 

Monitoring the budget regularly to see if 
adjustments need to be made. 

** 

Fulfilling the objectives as stated in the 
contract . 
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Keeping coitwiuhicat ion lin^a iinternally and 
external ly) often to ensure cooperation and 
maximization of r.esburc?ea throughout t^ie pro- 
ject. 7 

Conducting the evaluation on an ongoing basis 
throughout the project* 

Phasing out the project and disbanding the 
project team properly hnd with sensitivity. 



DESIGN THE PROGRAM TO MEET THE 

NEEDS OF YOUR TARGET AUDIENCES: WHAt 



Plan programs appropriate for your target audience , 
not for "the public in general," and you will be much m 
successful. After you *>ave assessed the needs of < the 
people you serve an$ analyzed /them and their problems, 
as discussed earlier, you are now ready to design your 
program, / 

Identify specific subject matters appropriate for 
your target audience. (Th^ques t ionnaire on , page 20- 
23 might help you in doing ttiis.) Creativity in adult 
education programming is of great importance. Many 
adults do not want to go ba<?k to the formal education- 
al system which they left many years ago. In order t& 
reach them, you need to be creative in what you pre- 
sent and how you present it. Consult the chart on 
"Possible Consumer Education Titles" on pages 56-57. 

As a pract ical example of the program 
desigp of a community pytreach program,' we agaitf cite 
the project "Helping Families Adjust to Econdmijfc 
Change." Its major objective was to reach and hel{J 
families with information on budgeting, decision 
making, credit, insurance, saving, family communica- 
tion, and general money management and to develop edu- 
cational materials as necessary. Notice from the , 
components identified below that this program was 
designed to meet the consumer needs of particular 
communities throuqh a variety of procedures and 
activities : 

Components of tfhe Project 

, » 
The outreach, phase explored the use of a 
van at different times of the day and at 
different locations as one method to reach 
new audiences. New, Brunswick, Sayreville, 
and Perth Amboy, with their different ethnic 
blends, were selected as sites. 
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The program also used community roojns and 
consumers' homes to hold classes In, and 
asked the support of community leaders , 
local agencies, and civic groups to help 
increase the outreach. 

Another aspect of the community outreach 
phase was to contact consumers through 
their employers by of f erin<j*classes in 
gompanies and firms. The program also 
benefited the employer, who is an integral 
part of the community, by generating better 
educated and adjusted consumers who are 
able to cope with the pressures of day- 
to-day expenses. , * 

^The development of educational materials 
for educators to help consumers solve 
their personal financial problems through 
proper decision making was another com- 
ponent of the, project, as was the. develop- 
ment of consumer fact sheets packaged as a 
home-study correspondence course. * 

* 

The eyaluation phase was concfucte^ under 
the leadership of an outside evaluator. 
This phase also included the development 
of program indicators and proper evalua- 
tion, instruments. This was an ongoing 
process, done with support and constant t 
feedback from all of the professionals * 
involved with the project. 

The project has national impl icat ions the final 
report, evaluation cpnclusions, recommendations for the 
future, and the materials developed are being dis- 
tributed through all land grant universities to 
Extension educators and consumers. The findings 
and writtefT materials help community educators in- 
terested in establishing, a local or regional con- 
sume* economics program to do so with the least amount 
of effort and expenditure of human and financial re- 
sources. 



DELIVERY SYSTEMS: HOW 
» 

In order to get your message acrosg successfully 
you need to look into various ways of teaching con- 
sumers. Methods of 'teaching and reaching peoplte with 
consumer education information which have, at one time 
or another, proven to be successful in adult community 
education include: 
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Direct teaching of groups through clashes, 
workshop*, panel discussions, forums, short 
courses and mini sessions, discussion groups 
and speeches given in community rooms, schools, 
and colleges? teaching and disbursing of in- 
formation in mobile units, in homes, at places 
of work (lunch and learn) , in libraries, 
through social or service clubs, through 
civic organizations, at religious sites; 
and teaching on a one-to-one basis in- homes. 

'"News letters , home-study courses* and self- 
learning kits geared to specific audiences 
and offered in homes to young mothers, the 
elderly, working couples, etc., 'who cannot 
easily attend meetings. 

i 

. Fact sheets and leaflets on one specific * 
topic; flyers bearing, short messages, left ^ 
at places where consumers congregate. 

Use of mass media including consumer articles 
written for newspapers and/or magazines, 
regular newspaper columns, radio announce- 
ments, appearances on television shows, cable 
TV programs • 

" * * 

Displaying educational material (one or two 
sets) in doctors 1 and dentists' Qffices, 
with flyers on hand to register for classes 
or to receive further information; / distribu- 
tion of educational literature (leaflets) 
through Welcome Wagon hostesses. 

. Telephone answering service on specific 
topics at certain times .staffed by pro- 
fessionals or paraprofessionals; automatic 
telephone service offering a choice of two- to 
three-minute cassettes containing information 
4 0 ri differed topics. There might be a tele- 
phone tape library offering educational three- 
five-minute messages on selected topics, pre- 
sented in laypepple's language. As examples, 
' many hospitals offer this service as a ' 
"health information* telephone service; 



actual example of the planning arid, implementation 
a home-study course is presented on pages 39 to 44 
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County Extension office, may offer this 

Dial-a-Maasage" system for homeowners 
on aubjecta such as landscaping and plant 
diseases, home and family living topics. 

Envelope stuffers with educational messages 
for enclosure in such things as bank state- 
ments and utility bills. " 

Recruiting and training volunteers or para- 
prof essionals to work with individuals or 
families in people's homes or in small group 
s 1 tuat ions . * * r 

Educational exhibits at county or local 
fairs; a booth offering information set 
up, at supermarkets, department stores; 
setting up a fair in a shopping mall. 

Consumer information offered through in- 
house organizations, such as an industry 
newsletter to employees. 

Traveling mobile unit offering consumer 
education in an informal manner at shopping 
centers, parks, etc. * r'H* ,, y 



THE HOME-STUDY COURSE 
(An Example) 

o, 1 fr„^H an < .i^ rJ ^ i0n deliver y system of community 
outreach, Jtp^oM- study course provides; 

„^a method%5r reaching people for whom 
attending learning sessions is not 
feasible; 

- a method of imparting more comprehensive 
information than is general^ possible in 

. the time restraints of learning sessions; 

- a method of continuous monitorimi of par- 
ticipant reaction and interest to the 
course administrator; 



bv SS2a T the E ™EP Program funded 

by USDA. Expanded Food and Nutrition Education 
Program - U.S. Department of Agriculture - SEA/ 
. Extension - Washington, D.C. 20250. 
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- a method by which participants can gain 
knowledge and skills in a desired subject 
area in the privacy of their own home, 

on their own time, and at a modest expense* 

- written information on subject areas which 
gives participants permanent access to the 
information; ^ 

a method by which participants can share 
the information and/or materials with 
other family members and friends or to 
* use in their work, if applicable; and £ 

a catalyst for family communication and 
decision making. * 



Design 

In congruence with the project objectives, five 
topic areas (units) were included in the course "Your 
Money Matters'* (written as part of the project) . 

Unit I - Financial Planning 
Unit II - Coping With Credit 

Unit III - Planning For Protection - Life Insurance 
Unit. IV . - Financial Aspects Of Buying A House 
Unit V - Making Your Money Grow <v ' 

Each of the units was mailed in a titled folder 
and contained: 

1. A cover letter. 



2. - Fact sheets: 

a. Each fact sheet discusses a specific 
aspect of the unit topic. 

b. /Fact sheets are divided in€o sub-topics 

with short discussions under each heading. 

c. Each fact sheet consists of two to four 
pages. 

d. Fact sheets are consecutive ly\ numbered. 

e. Fact sheets in different un^ts are printed 
on different colored paper. 

\ 

3* Quizzes * 
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Participant feedback mechanism through* 

a. A question the end!\>f eaoh qui* - 
H Hav^ you used or shared any of this 
information from the fact sheets, or 
do you plan to? If yea, in what wAy? H 

b « An of\er for supplemental material for 
most/ units . ^ 

5. Pamphlets, charts, additional fact sheets, 
or other material which amplifies the unit 
topic, 

• 

6. Envelope addressed to the course administrator 
in which the participant may return the quiz. 

t ' 

I mplementat ion \ 

To promote the course and enlist participants, 
the following strategies were used: 

, Newspapers - articles were written in the local 
Yiewspapers about the project, including an ex- 
planation of the horns-study course and information' 
needed for registration. 

An announcement was prirrted in tfhe County Home 
Economics Extension newsletter. 

A/eover letter and registration^ orms were sent 
td#community service organizations, such as the 
YWCA, Urban League, Middlesex County Welfare 
Board, etc. * 

A cover letter and Registration forms were sent 
to other individuals and groups who had had 
previous interaction with the project. 

Administering the Course 

' The process of % afmi nis ter ing the course was as 
follows: 

1. A cut-off date fdr registering for the 
course was announced. 

2. The first unit was sent* to registrants. 
In addition to the ' aforementioned 
matej^rf, this unit contained: * 

a. A brief description of the topics in 
each of the units, and 
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b. Procedural directions for taking the 
course, including the schedule for 
returning the qui* and receiving 
succeeding units. 

i« A three-week interval was allowed for study. 
The qui* was returned to the course adminis- 
trator within this interval. 

4. The returned .quiz was corrected and photo- ' 
copied by the administrator. (No actual 
grade was placed on the quiz, 'but incorrect 
answers were marked and explained.) 

5. On the scheduled day the second unit was 
sent to all registrants. This packet also 
containedt 

a. The corrected quiz from the previous - 
unit, if returned; and 

b. Requested supplements from the previous 
unit, if offered. 

6. This process was repeated' for each unit, 

7. A congratulatory letter and certificate of 
% completion was sent to participants who. 

completed the five-unit course* Completion 
is established tyf a participant marked and 
returned all unit quizzes. 

The attached chart was found helpful for record- 
keeping purposes and administration and evaluation of 
the course. 

Suggestions For Using the Chart : 9 r 

- Alphabetize names of registrants (it also helps tp 
alphabetize the photocopy of the quizzes in unit 
folders by registrants' names for evaluation.) 

- For each unit, record: 

0 

date sent - if the date is the same for all regis- 
trants, it need only be written once, then check 
this column for e$ch participant as his/her unit 
packet is mailed. 

quiz ^received - as each quiz is received by the ad 
ministrator, the date is recorded in this column 

quiz gradfe - although no grades appear on quizzes 
returned to participants, the number of correct 
answers is placed in this column. 
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used or shared - if participant indicated that 
the information or material was 
used or was shared with others, 
this column is checked. 

\ 

Finding the optimum way of reaching people* in- 
cludes considering -optimum location ahd appropriate 
time (the where and when of your program) . 



FJNDING THE -BEST LOCATION: WHERE 

Finding the best location means asking yourself 
the question: where do people congregate? Are the 
consumers you want to reach young, newlyweds. a young 
couple with children.- or elderly? The places where 

'S!SL !k 6 6ly t0 be £ ound wil1 differ depending upon 
whom the consumers ar^>you want to reach. 

Newlyweds migfc be located by looking 
through marriage announcements in news- 
papers, through a religious organization, 
or through a newcomers' club" or Welcome 
Wagon type organization. 

Elderly consumers might' congregate at 
senior citizen centers, religious centers, 
the YWCA/YMCA, YMHA, or other such in- 
stitutions. 

. Young families with children will be very 
busy at home and the adults involved might 
not be able to leave the house- as often as 
they would like, although they need informa-. 
tion on how to handle financial matters, how 
to treat children in terms of money, and how 
to help them become effective consumers. Why 
not reach theft through a newsletter, telephone 
messages, consumer memos, supermarkets, or 
pediatricialtta-7 

*? d 2 A £i 0n ?J inf °™ation can be obtained frpm "Reachina 
and Teaching Young ramilies," A Handbook for Exten- 
sion-Staff, Extension Service, U.S. Department of 
Agriculture, ESC 573, Washington, D.C. 
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The following are examples of creative places 
consumers might be reached with information; 
some will be repetitive, but* have been in- 
tentionally placed here to reinforce their 
importance * 

At home (home-study units, newsletters, 
fact <sheets) ; public places (libraries, 
posters in supermarkets, flyers) ; or- 
ganizations (tenant's organizations) , 
clubs (Lions , Women' s Club) . 

On streets (flyers, announcements of 
programs, mobile unit ) - 

At place of work (lunch and learn pro- 
grams , in-house news letter , envelope 
stuffers with paycheck). 

At religious centers (after-service 
program for parents while youngsters 
have an orqaniyed program). 

At community centers (all times). 

* 

Local offices of Cooperative Extension 
Services, YMCA' s/YWCA 1 s and adult schools, 
colleges, day-care centers, (information 
about programs can be sent hqme through 
^ youngsters ) . 

At places where people bank and conduct 
their financial affairs, such as banks, 
credit unions , investment and insurance 
brokerage houses (exhibits , information 
booth, leaflets included in their mail- 
ings) . , 

Agencies (fact sheets , consumer informa- 
tion to those on the ir-4aai ling list), 

\ At doctors 1 or dentists' offices 



(literature, program announcements) . 

At unemployment offices (literature, 
learning sessions announced). 

In parks and at public or private 
recreational f acilities - 

In stores and shopping centers and malls. 
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CHOOSING THE OPTIMUM TtMEi WHEN 



The time t>f day one offers a program is of great 
significance. To illustrate this point, more and more 
women work today. Many are too busy to go out at night 
to an educational program; neither are they home during 
the day (Monday-Friday) for discussion group seminars. 
But Saturday might be a good time to bring them out 
for a seminar. Newsletters will certainly reach them 
at home as would home-study courses or mini-units. 
Saturday might also be the day the spouses would join 
them i n thai r endeavors . 

A lunch and learn program conducted at an em- 
ployer's site offers good timing and a convenient 
location. Similarly a program can be scheduled for 
young mothers at the library while their children 
are busy attending the story hour. The following 
examples are offered as strategies involving suc- 
cessful use of the elements of time and place: 



Overv iew 

In April, May, and June 1978, three Lunch'N Learn 
series (a total of 12 sessions) for university sec- 
retaries were initiated and conducted on the Rutgers 
campus. Each series consisted of four one-hour ses- 
sions (one per week for four weeks) on different areas 
of family financial management and included after- 
session counseling in two of the three series. All 
sessions were held during the lunch period at a facil- 
ity provided by the university. 

C onclusions and Recommendations 

The use of the lunch hour for learning sessions 
was found to be an excellent time to reach working 
consumers. The participants in this program were 
more than willing to make use of their lunch hour 
by attending this free mini-course. The major ad- 
vantage of. this approach is that it allows working 
consumers time for self-enrichment through learning 
sessions without adding to the time they spend away 
from home. 

The major drawback is the strict time limitation 
aval lable^ for the session. Thus for a lunch and learn 
series to be effective, the following suggestions are 
recommended: 



LUNCH 



H * N LEARN SERIES 
(An Example) 




1) The meeting place should be within short 
walking distance of the target audience. 

2) % Coffee or til ahould ba provldad and ready 
at tha appointed hour. 

3) The presentation must ba veil organised If 
material la to be covered. However, when 
teaching adulta, tha presenter must always 
remain flexible in order to meet the needs 
of the participants. 

4) Queetion-and-answer and discussion formats 
are important teaching methods which add to 
the informality and rapport between the 
presenter and learner, but these methods 
must be moderated carefully due to time 
constraints. 

5) If possible, it would be advantageous to 
enlist the cooperation of the participants 9 
employers. It might even be possible to 
extend the lunch time. From a public re- 
lations angle, remember, however, that 
participants must be back at work at the 
appropriate time. 

\ 6) Experience showed that it is beneficial if 

the presenter plans for extra time to answer 
personal questions from participants after 
the end of the session. Thus there is ad- 
ditional teaching/learning going on for those 
participants who want and can stay longer. 



AN AFTER-HOURS PROGRAM WITH INtftjSTRY 
\ (An Example) 

Overview 

Three series were conducted at two New Brunswick 
companies. Each of the series offered sessions in < 
family financial management presented by professionals 
In different areas. The learning sessions were held 
at the end of the work day on the premises of the co- 
operating industry. 

The community coordinator organized the series to- 
gether with the personnel managers of Midland Ross and 
Surgikos. The project director was part of the plan- 
ning committee and conducted individual sessions at 
Midland Ross and Surgikos. The Midland Ross program 
reached both middle-management and blue-collar workers. 
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The S^urgikoa program included only management and 
secretarial personnel • 

Conclusions and* Recommendations % 

Employers are becoming increasingly aware of the 
advantages of providing nohwork-related services to 
employees. Thus, in art effort to improve employer- 
employee relations, many companies 'are willing to co-' 
sponsor programs for the self-benefit ot\ the workers. 
Companies may be willing to supply meeting rooms on 
the premises and provide advertisement ajid promotion 
for a series. 
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After completion of the Surgikos series/^*? con- 
ference was held with Mr. Weisberg, Manager, Organi- 
zational Planning to discuss his assessment of the 
program as it was presented to Surgikos and his sug- 
gestions for, and input into, the most effective 
methods of working with industry. 

He felt the series was vy&ry well organized and 
presented, the speakers excellent, and the topic 
covered of interest and importance to all consumers. 
He felt his company benefited by providing this ser- 
vice to the. employees . The following recommendations 
surfaced at the ^valuation meetings held after the 
sessions and interviews with the personnel manager, 
project director, and project coordinator : v 

Wh en Working with Industry, Consider the 
FolTo'wing" "Suggest ions : 

1) Contact the president of the company 
or the personnel manager responsible 
for programming. Explain fully the 
purpose of the service (a flyer is 
helpful) and the benefits to the 
company of co-sponsoring this type of 
program . 

2 ) Present examples of past performance 
records . 



3) Have a workable course outline giving 
potential sessions, dates, speakers, etc. 

4) Record in writing all delegations of 
authority, i.e., methods of promotion , 
when and by whom promotion is to be 
carried out, etc. 

5) Enlist the cooperation of labor union 
officials if applicable. 
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6) Make sure that you have the ful\ cooperation 
of the personnel manager and/or union leader 
or others on your planning committee regarding 
distribution of promotional brochures and that 
full moral support is given to the project 
team. 

7) Conduct a' needs assessment in cooperation 
with the .personnel manager .and/or union 
Reader to pinpoint exact needs and problems 
of the employers which the program will try 
to meet. 

8) After informing employees of the results of 
the needs survey, include a registration form 
with the program outline and make registra- 
tion mandatory by a certain date. 

9) Have a simple evaluation form prepared to 
hand out at end of series to be filled in 
by participants. 

10) Share tabulated data and results of evaluation 
with your industry liaison person and the - 
planning committee to assure future co- 
operation. Industry representatives are 
used to working with figures and always 
look for tangible results. Your performance 
of an evaluation and dissemination of the 
results will be impressive and will command 
their respect. 

The illustrations presented in this chapter are 
just that — illustrations. With particular reference 
to project planning and development, keep in mind that 
creativity and ingenuity are many times the only 
boundaries in an educator^ quest for new horizons. 
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WHAT IS PROJECT IMPLEMENTATION? 



Implementation is the action taken based on your 
program design. It is the real productivity test. It 
indicates who was taught when, what, where, and t\ow. 
It is here that the success of your community outreach 
program will be tested, weighed, and decided. 

If your planning has been thorough, there is no 
need to be afraid of failure. If some strategies do 
not work *as you , had anticipated, do not be afraid to 
admit this and to *make the necessary changes. This i» 
what, program planning, design, and implementation are 
all abbut. * 

The following two ideas, stressed by Silverman in 
Project Management , have been adapted by* the authors 
for educationalprojectsz * 

1. The jump from planning a project to actually 
coordinating and controlling it while in 

Nproceas is difficult for many people. Many 
professionals have been specialists of one 
kind or soother and now as managers have to 
be generalists, who oversee and, fcontrol. 

2. The requirements for successfully completing 
the planning aspects of a project are usually 
quite different from the requirements for 

* implementing and controlling that plan. 

In the beginning or planning stages of a project a 
"supportive or cooperative style is generally necessary 
in order to secure everyone's cooperation in a fully 
defined, rather fluid situation. Later, when pla>is 
are completed, designs frozen, and production underway, 
a more directed , business-like style is needed to meet 
specific time-coat restraints." It is very difficult 
to change "one's management style" to meet the changing 
needs of the situation, but "in project -management , 
it's a ^necessity . " A successful "style" during the 
beginning phases can be a liability in the implementa- 
tion phase if it is unchanged. 

If you are interested in further 1 study on this 
topic, you might also want to read A Theory of Le ader- 
ship Effe ctiveness , Fred E. Fiedler", Mctiraw-hill, l9€7, 
or consult some other books on this topic. 
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EXAMPLES Or DIFFICULTIES AND BENEFITS 
IN PROJECT IMPLEMENTATION 

The authors, feci that it is important for project 
manager* (especially those for whom this role is a new 
one) to be aware of some of the difficulties which can 
be experienced in project implementation: 

Difficulty ^ith personnel . insofar as the/ are 
temporarily brought toother for the project. 
Also, personnel have different backgrounds and 
not enough time to get adjusted or not enough 
interest fro do so. 

There is a question of loyalty to project 
director . 

Other interests might be placed before 
project res pons ibi 1 i t ies , 

Time is needed to become familiar enough to 
communicate successfully regarding project 
needs. 

People outside the project team don't always 
understand mission and goals of the project. 

There might not be enough support given to 
team members from regular staff. 

There is great pressure' for "success" and for 
achievement in terms o€ reaching the project's 
goals • 

Many people find it difficult to have to 
leave the project after a certain period of 
time, although it was pre-arranged; some 
bitterness can result. 

the positive side, there are some real benefits 
as the program' implementation as concerned, 

s : „ 

great flexibility (at least greater than in 
the regular program where channels are . 
established) . 

the generation of new ideas . 

creativity can be at its peak, 

possibility of trying things, out art the spur 
of the moment or on relatively short notice. 



On 

as far 

such a 
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a relatively inexpensive way of putting to- 
gether or trying out some new project ideas, 
if they do not work they can be discarded ; 
chances are that there will be some very 
good results coming from the project, even 
though some might be different than expected.* 
If the ideas work out as projected, so much 
the better; t^hen the entire process can be 
applied on a larger scale and integrated in- 
to the regular program and into the larger 
organizational structure. 

nromnJ?^ nt r ° f pro ^ ram implementation include the 
promotion of your project and the delivery or action 



MARKETING YOUR PROGRAM ' 
(Project Promotion) 

General Strategies 

General .strategies towards successful implementa- 
tion and promotion include: inipiementa. 

'* ?! k i n V plan that includes resources you have 
at hand and a time frame. c 

' ^SImI^? 9 5 he varioua methods of implementation 
available to you and selecting one or two which 
you feel is best suited to your audience 

• Using community resources for coordination of 
efforts; maybe y P u need a\ co-sponsor for your 
program, or need assistance in Other ways. 
You can use pommunity resources for facilities 

^ : P 5* ker * and aS ref «"i information 
and audiences. See the chapter on "Utilizing 
Community Resources" in Personal and Family "* 
Finances, a Resource GuiaTTor Teac hing: — *~ 



«li?L a "25 y commit tees in program imple- 
mentation. The roles they play can va*y 
greatly. To make them effective, it is 
important for you to analyze for yourself 

InH I^ nMd * hem ' how y° u wil l «ae them, 
and what you have to offer in return (more 
on the use of advisory committees can be 
found at the end of this chapter) 
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Employing tome or 'all of the following 
suggestions i 

Develop a folder on your organization and 
the project; include all relevant material. 
This folder can be used when introducing 
the ( program to people in the community, 
industries, agencies. 

Identify weekly* and daily papers, shoppers' 
magazines , radio stations, and supply them 
with promotional information on an ongoipg 
basis. 

Develop attractive, inexpensive flyers 
about your project. Send letters to 
key leaders in your community. Such 
flyers and brochures can be included 
with the letter to help sell your pro- 
ject. 

"Package* your educational program in an - 
appealing and creative way. Thlrf means 
choosing an innovative title for your 
program, such as "Money Matters for Teens" 
instead of "Budgeting fdr Teenagers" and 
including an exciting course description c 
The following list of titles might .give 
you some ideas on developing your own program 
title: 



LIST OF POSSIBLE CONSUMER EDUCATION TITLES* 
Families in Crisis 
Non-fault/Default 
Stress Points 

Family Adjustment to Economic Change 
Think for Yourself 
New Coping Techniques 

♦These ideas for titles are the result of a brain- 
storming session with R. Friedman, 1 6. Maoauley, 
A. Burkart, F. Minifie, R. Speelman, (Extension 
Home Econqmics Specialists) on creative topics and 
titles in consumer education in 1977. 



Creative Coping for Consumers 

Shifting Gears in^£Jtnancial Management 

* . ** 

to Cope or Cop Out I 
Adapting to Change 
Adjusting to Change 

From Stress to Sucaess V 

. j V 
Availability erf Resources^ 

Financial Independence - Fact or Fancy? 

Tunnel Vision or Vista Vision 

Focusing Goals for Consumers 

Real Problems - Real Solutions 

Instant Society - Instant Success 

Be Your Own Expert 

Explore Your Options 

Consumer for All Seasons j 

Locking ^Yourself into a Life-Style / 

►From Cadillac to Pontiac - Realizing Your 
Limitations 

«_ 

Financial Stress and Strain - A Habit? 
Time Trap - Money TTfap 
Spending Yourself 
Don't Panic - Adjust 

\ 

Environment - Consumer 
( Fyture - Stretch: { 

- 'Offer refreshments and a sparfal hour. 
This activity can serve t6 break the 



ice. 



- Negotiate with the industry and labor 
unions wherte you are holding your pro- 
gram to have half the time for the Zourae 
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donated to employees, the other half 
being the employees 9 contributions. 
Let this be known to thf people in- 
volved well ahead of time. 

- Announce that you will be giving out 
certificates of achievement to those 
who attend the entire course. 

- k\tme might be charged (e.g., $6 for 
a six-session course) , and returned 
to the consumer after completion of 
a course. 

- Write short, appealing, meaningful 
radio announcements, flyers, news 
releases, or feature articles for the 
local newspaper/ 

The project director can either be 
interviewed by a staff reporter or 
the announcement can be developed 
jointly. Post the flyers in super- 
markets and libraries, deliver them, 
to homes, of consumers, and distribute' 
them through organizations. 

Include an interesting person on the 
program who "draws" crowds (it can be 
a local politician, some respected 
government official, or a celebrity). 

Last, but not least, go out and find 
consumers at places where they con-. y 
gregate : hospitalg, baby health f 
clinics, women's centers. Explain 
your program directly and give out 
flyers and brochufes. 

Tailor Your Promotion To Fill 
Special Needs ~~ 

In addition to the regular promotional activities, 
you need to develop a specific promotional strategy 
for the particular project you are, planning . 

The strategy is different when you promote a 
program geared towards industry employees in-house 
as opposed to one which is open and aimed at the 
general public- The promotion of the latter will 
differ again dep&nding^ on how you deliver the program. 
For example,- if you co-sponsor a project, the announce- 
ments will go t6 more than one mailing list and will 
reach more people. 

\ " 58- 
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The promotional strategy adopted will also depend 
on the type of audience you are trying to reach (e.g., 
young families, senior citiiena, etc.). You need to 
be lure your information will reach your particular 
audience. 

Only you can develop a promotional strategy which 
will work for you. The following examples might help 
you in developing your own successful marketing style 
and approach. 

A Promotional Strategy Involving Retail Businesses 

This strategy was developed and implemented in the 
federal project (a similar strategy can be employed 
when working through industry establishments). 

You decided that you wanted to work through retail 
establishments in the designated community, either to 
co-sponsor a project for company employees or perhaps 
to utilize their credit manager as a resource person 
for a class open to the public using their community 
room or some other location. You h«ve chosen the re- 
tail establishment because a large number of people 
walk thrQugh retail stores, and many of these people 
would benefit from your information and your program. 

What do you do? 
Step 1 

Identify retail establishments in the Communities 
in which you want to work. Gain their cooperation and 
assistance for your project. 

Dra,ft a letter of introduction indicating the 
who, what, when, where, how, and why of the 
project; al*o say what typp of support is 
expected and why. 

Identify the decisionmaker (s) Lry the retail 
establishments - who has authority to make 
the programming decision. Address your 
letter to this person (e.g., the general 
manager or personnel manager) . 

Explain hcKi cooperation on this project will 
help the retail establishments. 

Explain how their cooperation ca~n and will 
benefit consumers. 
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Nail a model letter to 'those retail establish- 
ment! interested in your project (eeoh one 
receives an original letter, not a photocopy). 
Enclose a pamphlet or other pertinent printed 
materia). (This pamphlet should have informa- 
tion on the project to familiarise the r^l f 
ceiver with the project.) * 



Contact key people in the above establishments 
by phone as a follow-up to the letter. 

Arrange appointments. 

Meet with people in the personnel department 
and with those in the organization's office 
of development and consumer affairs and/or 
public relations department. If there is a 
union involved, include a union member (steward 
or other) as well as a member of the group to 
which the program is to be ^presented , if pos- 
sible. 

3et a date for a program planning meeting 
regarding specifics of content, time, and 
resources needed. / 

Follow up the meeting with a letter to reinforce 
the intention towards further cooperation, an 
to thank the manager or personnel officer for 
his, or her time. 

Organize the next planning meeting: Proceed 
with implementation of the program (choose 
title, order rooms, invito resource people,** 
promote and hold the meeting; after the pro- 
gram is completed, do necessary follow-up and 
evaluation) . 



Basi c gteps in Implementing a Conference * 

The following is a detailed planning guide. 
Although thje steps were developed for the planning, 
implementation, and evaluation of a formal conference, 
they will stimulate thinking and can be readily adapted 
to the management of any type of educational program. 



♦Quoted from* Training Program for Consumer Education by 
Lynn Jordan, former President , Virginia Citizens Con- 
$umer Council. 



Step 2 
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(1) Determine the purpose and objectives of the 
conference. Decide whet you went tp ac- 
complish and who your audiepce will be. 

(2) Choose a conference committee. The committee 
should decide who will make decisions and who 

will do the work. 

(J) Write a proposal and secure funds. This 
requires preparing a budget. 

(4) Determine the agendai topics, speakers, 
format, group rules. Go back to yout 
objectives. Be specific when you invite 
speakers; tell them exactly what ydu expect. 
In most situations, it's probably best to 
develop a format that will encourage in- 
teraction among participants. 

(5) Select conference facilities. Consider th* 
atmosphere: will it encourage participation? 

(6) Develop criteria for choosing participants. 

(7) Publicize the conference. 

(8) prepare brochures and application forms and 
use the media to recruit participants. 

(9) Locate housing and- transportation for 
participants and speakers. 

(10) Prepare background materials and conference 
program. If you expect participants to do 
pre-conference reading, let them know- Also 
send participants maps, conference schedules, 
information about available time for sight- 
seeing, etc. 

(11) Assemble equipment and confirm arrangements. 
Contact the facility's staff on a weekly 
basis the month before the conference. 
Confirm arrangements with equipment suppliers. 
Call or write all speakers about a week before 
the conference M just to make sure tjrey have no 
last minute questions or problems." 

(12) Prepare facilities. If possible, visit the 
facility the flay before the conference begins. 
Make sure ^someone is on hand to greet partici- 
pants, especially speakers and discussion 
leaders. 
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(13) Hold the conference. If you have done a 
good Job of preparation, this ia tha aaaiaat 
part; Soma things will go wrong, but you 
will hava anticipated them. Try to atay on 
schedule. 

(14) Conduct follow-up activities. If participant! 
are assigned follow-up activities keep in 
touch with them, 

(15) Evaluate the conference. Try to identify, 
what you did well, and what you could have 
done better. 

- (16) Report the results. Write a report on th* 
conference for your funding source, members 
of your committee, etc. Uae your experience. 
Write a "how to H manual £pr fellow educators. 



WORKING SUCCESSFULLY WITH AN ADVISORY COMMITTEE 

Many projects require the establishment of an 
advisory committee or board which should include 
some consumer representation. The roles committees 
play can vary greatly. For example, the committee's 
general function might be to advise on all aspects 
of the project, or just on one particular segment. 
Whatever the role it plays, you can be the beneficiary 
of pooled talent, enthusiasm, and knowledge. To make 
advisory committees effective, it is important for 
you to determine why you need them, how you will 
utilize thenv, when and where you want to meet, how 
long meetings will last, how often' you will need tQ 
meet, and what limitations there are on the .authority 
of the committee, if they have any authority at all. 
You might also consider what you have to offer in 
return for their cooperation or participation. 



C ommittee in Program Implementation 

Here is an example of how an advisory committee 
developed a strategy to improve the effectiveness of 
a consumer education outreach program. 
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RUTGERS UNIVERSITY - COOK COLLEGE 

COOPERATIVE EXTENSION SERVICE 

* * 

FEDERAL PROJECT : 
helping Families Adjust to Economic Change" 



FEDERAL PROJECT ADVISORY 
COMMITTEE MEETING 



RAMADA INN 
Rutgers Room 
New Brunswick, N.J, 

December 8, 1977 



The people invited to participate were chosen 
because of their willingness to /participate, their 
expertise in consumer education, and/or knowledge 
of the community. Th* group included representatives 
from banking, industry, education, and community 
agencies. 

The preparation for the meeting lasted several 
days. The committee meeting itself lasted half a day. 
The entire project staff was involved in one way or 
another. The committee was oriented toward the over- 
al/L project and given a specific objective to work 
towards : 

The objective of the. meeting was to explore ways 
to effectively market the consumer education project 
to different audiences in Sayreville, New Brunswick, 
and Perth Amboy. The committee dealt with: 

*ways to reach target audiences (methods, 
strategies) . f 

how to increase the number of clients (making 
service more appealing, taking into consideration 
changing life-styles, etc, ) . 

how advisory committee members can contribute 
to the educational delivery system. 

After the initial introduction, review of the 
objective, and presentation of the scope of the 
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overall project, the advisory committee member* 
divided into four groups # each group having respon- 
sibility for one specific audience type (see exercise 
charts 1 and 2 on pages 65-69). Four individuals who 
were knowledgeable about the project were given proper 
instructions and guidance and served as discussion 
leaders for each group* 

Each group selected a reporter who, at the end of 
the brainstorming session, reported to the entire com- 
mittee the types of delivery systems on which the 
group had placed priority. The evaluation of this 
mooting showed that the advisory committee members 
felt the format was successful and the time spent was 
well worth their effort. 

When selecting members to your advisory committee, 
you should include, if possible, someone from the 
audience for which the project is being planned for 
identification of interest. Other members should be 
chosen carefully as to their sensitivity toward your 
program/ what they can and might want to contribute, 
educational background, etc- The professional talents 
of the individuals as well as the benefits advisory 
committee members can derive through this involvement 
should also be considered* 
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GROUP SESSION I 



FAMILY 
INCOME 



GROUP BRAINSTORMING ACCORDING TO FAMILY STRUCTURE 



45,000 



SINGLE 
PERSON 
HOUSEHOLD 



5,000 



TWO 

PERSON 

HOUSEHOLD 

B 



TWO. OR MORE 
PEOPLE IN 
HOUSEHOLD 



This group works with; 

5,000-45,000 income level famfTyT 



(Group 



Identify types of singl* household audiences: 
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2. Looking at the cownunity.da.ta aheeta, ia thara any clue aa to what group(a) 
warranta priority attention? Be aa apecific aa poaaibla. 




> 
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3. Cite specific methods (delivery systems) which might appeal to 
different target audiences . 



4. 



l°l M ?r2if a Sf a !! con J 0nt •PPMlingly? (according to subject matter, 
e.g., Credit right.! Programming your $'s,or according to audiences) 



5. How can we increase our audiences? 



rP 



6. How can advisory committee. members contribute to the*de"livery, system? 
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GROUP SESSION #2 
STRATEGY (mat hod) 



WHO: (target audience) 

HOW: 

WHERE: 

WHEN: " i 



r 

A Second Illustration 

The following example consists of the second major 
advisory committee meeting which was held four months 
after the first*: 



"Helping Families Adjust to Economic Change" 
USDA specially funded project 

Second Advisory Committee Meeting' 
April 18, 1978 

Holiday Inn ' * 

Route 1 
x North Brunswick , N.J. 

* 

Agenda 

* ** 

- Committee members arrive and register w 

- Welcome by Dr. John Gerwxg 

- Informal introduction \f all committee members 

' « 

- Overview of project and hom£-study course by 
Denise Matejic ^ 

\ lf 

^ - Reports by; ^ , « 

Dr. Huang - Evaluation - 

Richard Sprince - Community Outreat:t) ^ 

. * 
Suzanne Bonamo - Lunch'N Learn,, (On -Qampus, 
Outreach) ^ ^ , ' ' • * 

Frank McHugh - Sub-committee ■» *Pub*lic Cgmmunica 
tions Liaison (Banking Staffers), * 

•Throughout the duration of the project -many Informal 
meetings were held with' various members of the advis- 
ory committee either by'phone or in person. Th «{-8 was 
done on a smaller more informal basis as needs arose. 



Viola Van Jonas - c*-jlponeor*d Community and 
» Campus Outrsach - Women's Center 

• Reaction to Objectives 

- Discussion of Objectives 

Adjournment 



foiled «° bjeCtiVea f ° r thlS committee meeting were as 

Objectives (as presented t o w 
member aT" " .. * 

To inform you what has- been' accomplished as 
an outgrowth of your suggestions from the « 
last meeting. 

* . To determine\f there are any aspects of she 

program that'ean or /should be continued after 

the deadline of the broject. 
f « 

If so, to decide how you or your organization 
can help continue the outreach program and / 
I promote the concept's taught on family resource 
management within the guidelines of the Co- 
operative Extension Service. 

* /To identify any problems you might* notice in 
the implications of our program and sugqest 
possibTe solutions. \ > 

To share any successful programs you have had 
with consumers to see if there are any areas 
where wfe sheuld modify our programs to ensure 
their sudcess. 

The above example illustrates the successful 
cooperation between a project team and the community. 

Depending on your funding" and your project's needs 
you can involve an advisory committee a£ early as the 

SSliUTin 9 ? tage ' ° r 1?A , r in ^ hG im Pl^entacion o* 
evaluation stages. * < 4 
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TOOLS FOR IMPLEMENTATION 



If project management is new x t^ you, chances are 
thi following tools will helj> youi ^ 



Timetable 
4 



To facilitate the reaching 
maximize your project staff's 
energy, and money, you need to 
develop plans of action which 
will be accomplished, who will 
what individual or group activ 
completed. The following char 
setting up your own schedules* 
filled in by writing down the 
needs to be accomplished (see 
tions) • r ' 



o£ objectives. and to r 
resources of time , 

set up timetables and 
show when certain tasks 
. accomplish th«*n), and 
ity is in progress or 
tp* will help x ou in 

The blocks should be 
various tasks and what 
Table 4 for illustra- 



TABLE 1 



TIME SCHEDULE FOR ALL MAJOR PROJECT TASKS OR EVENTS y 
LISTED RANDOMLY TO BE COMPLETED FOR THE NEXT SIX MONTHS 
(OR YEAR) INCLUDING WORK DONE BY ALL PERSONS INVOLVED 
IN PROJECT * *> 



Tasks to be done 


Jan . 


Feb, 


Mar, 


Apr, 


May 


June 


Task Z 










* 




• 

Task F 














Task A 














Task N V * 














■* -*r 

Task Y ~] 
J 















'After tj>e x above chart has been filled out, analyze 
the tasks and list them in chronologic*! order of 
priority as fchown ih+Table 2, 



TABLE 2 



TTHE SCHEDULE FOR PROJECT TASKS OR EVENTS LISTED 

CHRONOLOGICALLY- AS TO BEGINNING DATE FOR THE NEXT 
SIX MONTHS (OR YEAR) 


Tasks to be done 


Jan, 
X 


Feb. 


Mar. 


Apr. 


May 


June 


Task A 












Task N 


/ 


X 


m 


> 






Task Z 






X 








Task P 




• 




X 




— > 


Task Y 















"X" shows beginning time and "the arrow" shows continu- 
ing task. If the task is to be completed before June, 
stop the arrow in the month of anticipated completion. 
For example, tasK M N" is to be started in February and 
completed in April. 

Task or Job Responsibility Charts 

If more £han one person is involved in the project, 
you also need to think throuqh &nd develop a group 
task responsib il ity chart ( a*). The following chart is 
one method you can use toTTIvide job responsibilities 
ambng people and analyze tasks. 

The first time you work out .this chart, have larqye 
pieces of paper available and list all tasks as they 
come to mint!. This type of activity can be done at. a 
staff conference or when all members are present and 
can contribute. 

The second time you prepare the chart, qroup the 
activities by their function to make the chart clearer. 
This i« an excellent ^management tool for analyzing 
tasks, readjusting workloads if necessary, etc/ 



TABLE $ 



Person^^ 


Person 2* 


Person 3* 


Person 4* 


direct project 
and coord inate 

rA\7*» r* >t 1 1 
K.J Vt3 I cl L 1 

project 


conduct consumer 
education pro- 
ctr am i n commun — 
ity 


assist in 

evaluation 
design , 


dirLt 
evalua- 
tion \_ K > 
efforts 


coordinate 
evaluation 
ef forts 


write 
releases 


conduct 
f ol low-up 
interviews 


design 
evalua- 
tion* 
model 


monitor budget 


promote programs 




supervise 

graduate 

student 

«» 


r 

\ 


«* 

observe 
teacher in - 
class and 
evaluate 
performance 





*Name of 

of each 



person 
task. 



responsible for completion 
\ 




Table 4 will show you at a g>%nce a combined time and 
job responsibility schedule (wnfcSsWhat, and when) for 
a person on the team. Be aware thSPfc these tasks are 
sub-tasks taken from Table 1 which included the entire 
project's time schedule. The blocks in the chart 
should be used by the person responsible to <J4£t t 
progress being made towatd completing the^indivHii 
(Note Task F, "Write Newis Releases.") f 



the 
iual 



task » 




Tasks 



TABLE 4 
(An illustration) 

TIME AND RESPONSIBILITY CHART OF PERSON 2 

_ 



Task F 



^mounce- 
ment Sent 
Jan . 5 . 



writ© 
news re- 
leases 



Task Y 



ETC . 



Jan , 



Feb. 



announce- 
ment of 
start of 

project 
to news- 
papers 



Mar. 



dead- 

li^ne 
far 

artic le 
in Apr.- 
May is- 
sue of 
prof . 
magazine 



Apr . 



May 



June 



To Summa r ize : * ' * 

You need to set up a timetable and schedule to: 

. remind yourself what has to be accomplished 
and when% 

. analyze tasks and set them in order of priority. 

. check if schedule is being followed closely. 

• check if schedule is on time. 

- modify if and when necessary, 

. start from the beginning, end at the end, 
evaluate thd program, and* Mtart the process 
again. ^ * • 
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FINAL THOUGHTS ON IMPLEMENTATION 



Your Aud ionce 



Kxh ibi t sens i t i v i t y toward your audiences • Take 
into consideration the changing world in which we live. 
Today's varying life-styles demand increased sensitivity 
by the teacher-educator to all audiences. Make sure 
that you have an understanding and acceptance of dif- 
ferent cultures and do not impose your values on others, 
Ho not make the mistake of thinking people are "odd", 
or Mo thin^N wrong if they do not, do'them the way you 

do. 

t n this eftort you need to also identify people to 
whom t lie audience can relate. Sometimes this, will be 
you, the teacher. Sometimes, if it involves a minority 
ot other' ethnic group, a professional who speaks the % - 
group's language or is familiar with the group you want 
to reach might be able to better communicate the educa- 
t tonal program and teach with you. . 



Working with Other People - Some Tips 

Before work ing with other agencies or organizations 
i n t tVt" community, before even approaching them to ask 
tot support or ,coopef at ton , or befor^ establishing an 
advisory committee, ask yourself som£ questions, as 
t he members of out project team tried to do on an on- 
go i ng ha sis: * 

What arc my objectives? What exactly do I 
want .>nd need from people? What do I expect 
t t om t hem ; 

What do I have to offer"? What will others 
gain from working with me? 

How ate they funded? Are there restrictions 

because of this funding? 

Is it really worthwhile? How will I know if 
it i*? What kind of control do I build in to 
stop the cooperative effort if it does not 
work out ? 

If possible, be friendly, but brief. Know in ad- 
vance how many hours you $re willing to invest in each 
component of your project. Great amounts of time can 
be wasted through committee meetings, if not used and 
planned wisely. 




A great deal pf d isappointment can be avoided if 
one follows the above advice. NotJPa.ll people are as 
dedicated and cooperative as they seem at the outset. 
Many agene iea • have their own strong interests and 
clients to serve and ate not set up for cooperative 
efforts, aigrtfugh some are. This varies from time 
to time, place to place. Learn to adjust to it. 

Ohatuj uuj Your Course of Act ion • 

There comes a time in every project when it be- 
comes obvious that a change in strategy is necessary, 
for whatever reason (not enough people interested, not 
successful). It can happen because one had previously 
made false assumptions, or did not have enough ex- 
perience, or did not know how to promote, or was not 
innovative and daring enough to try something new, or 
other factors. 

in that case adjustments must be made in teaching 
strategy or teaching content, or in the promotional 
strategy. It might mean discarding one method alto- 
gether and pursuing a different one. This might not 
be an easy decision to make, but it might spell The 
difference between success or failure of your project. 
The following examples have been chosen to illustrate 
changes in strategies made in the federal project be- 
cause of reastttis cited, above: 

Ex amp 1 es o f changes jm_St rategy 



Changing from one, major method of emphasis 
(e.g., lessons in community centers) to 
other alternatives. 

Ottering refreshments and a social hour before 
class and gearing the program to one specific 
audience; going in with the help of a local 
resource person. 

Utilising a mobile unit to reach consumers 
at fa i rs , and have innovative displays out- 
side as well as inside. 

Changing from the downbeat topic title of 
"What to do When in Financial Trouble" to 
"How to Make Your Money Go Further. " 



?8 
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Changing from exclusively working out of a 
van to using different approaches to better 
penetrate the community . 

4 

Working with other groups and becoming a 
speaker-resource person for their audience 
instead of only dealing with one's own 
group ( increas ing the number of people 
reached) . 

Giving out a door prize to the person who 
brings guests (or who brings the largest 
number of guests) . 

Scheduling a consumer education seminar in 
conjunction with meetings of other community 
organizations such as tenant rights groups. 

Project implementation is probably -the most 
important aspect of all of those things you have 
to do. Do not be afraid of it. If something does 
not work, try something else. Plans carved in stone 
are bound to crumble. Those made of plastic can be 
shaped as the particular shape needed reveals itself 
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^evaluation has always been considered an important 
activity, and is carried out in one way or another by 
most people in every aspect of life. Educational 
evaluation as a formal process is assuming greater 
importance now as the needs 'for accountability in- 
tensity.. Legislators, jpolicy makers, and administra- 
tors are increasingly demanding that program effective- 
ness be demonstrated through formal evaluations. These 
demands emphasize \he need for extension workers to 
obtain sound evidence of the extent to which their 
community outreach programs are successful. Formal 
evaluation entails conscious procedures for placing 
value on programs according to explicit criteria and 
designs for collection and analysis of evidence (USDA, 



In this chapter, the following areds of program 
evaluation wilK be addressed: 



contributing factors, and 

■ • ■ 

process of program evaluation. 

Since this chapter is written for educational 
prapfci tioners who have a genuine concern £or and ' 
the responsibility of evaluating* community-based ' 
educational programs, actual examples from our 
project are presented N to help readers generate 
^alternatives for evaluation purposes. 

Program Evaluation Functions 

Evaluation can serve many purposes to many people. 
As a pontinuous process • consisting of systematic 
planned activities/ evaluation can provide valid, 
reliable, and timely informatioo for a wide range 
S>f decisions — instructional, curricular, managerial, 
and policy making (House, 1977). 

In our project, program evaluation is part of the 
overall program development process, which includes: 
(1) community and clientele analysis, 12) objective 
setting, (3) program design/ (4) program implementation, 



evaluation f unct ions , 



obstacles of program evaluation*, 





and (5) program evaluation. It has provided tis with 
constant feedback for the purpose of program improve- 
went. It has also suggested reformulation of program 
objectives, strategy, delivery system, educational- 
methodology, and target audiences. 

In addition, program evalu&tion has assisted in 
reaching decisions on future direct ions^and design 
of community outreach programs. Decisions on whether 
programs should be curtailed, maintained, expanded, or 
terminates! have also been aided by information qep- 
erated through program evaluation. 

These major functions of our program evaluation^ 
have been derived through a careful deliberation and 
aha Lysis of the project goals and objectives stated 
in the funded proposal. They have provided^ sense 
of direction for the project director and the evalua- 
tor in developing and implementing the necessary 
evaluative strategies for the community outreach 
pro ject . 

Program Kv aluat ion Obstacles 

Program evaluation is designed for utility. Its 
purpose is to answer practical questions of decision- 
makers who want to know whether to continue a program, 
.extend it, modify it, or terminate it (Stuf f lebeam, 
1968). 

Program evaluation is often much easier to describe 
[in £he ideal than to do in practice. It is invariably 
Vplagued by a series of obstacles. A review of some of 
the most pervasive ones seems to be appropriate before 
an actual example is prosentbd to -illustrate the -'How?" 
in program evaluation. 

Obstacle One' - The goals of programs, especially 

community outreach type, are rarely 
simple and clear cut . 

Sometimes a program has a straight-forward goal, 
such as developing an educational package in family 
resource management for Extension professionals*. But 
often, program goals are many a'nd diffuse such as to 
raise the level of living for individuals and families 
in a county- Usually, the higher the deg'ree of vague- 
ness and generality of the program goa Is , the more 
difficult it is to assess the extent to which these 
goals have been accomplished. Hence,- one of the most 
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important tasks for a program evaluator 'is to ask 
potent questions to help the proiect staff crystalize 
their program goals. 

Qbstacl^ Two - Many program staff members are 
convinced of the program's 
worth and see little. need 
for evaluation. 

In most cases f the project staff is convinced -of 
the program's worth. If the results of the evaluation , 
are positive, they knew it al 1 alongSs^If * the results ' 
are negative, it ig probably the fault of the director, 
the evaluatoi^, or "the grossness of their measures, 
which are top insensitive to capture the subtle and 
important changes that are going on. - The Yesponsibi 1- 
. ity, therefore, rests upon the director and evaluators 
to help the staff understand and a^preoiate the value 
of program evaluation. At tiie same time, evaluators 
must take the time' and have the, patience to work with' 
staff members either ii> small groups or individually 
in the development of workable strategies and devices' 
for gathering the needed evaluative 1 information. 0 

Obstacle Three - Program staff may be reluctant- 
^ to cooperate wi th^valuator, 

The program 1 s staff members oft^n h^ve inter^ 
and professional norms tiif f erent^ f rqm'those of th 
director or evaluators. The*staff's concern is 
usually service. To ,£hem, evaluation could mean 
disruption and delay of service. They may not want 
to take 9 time from their primary role-^helpiog people 
*in order to fill out .forms or engage, in otJkier diver- 
sions that the. director and ^Valuators seem to^thin)^ 
essential, they need to be convinced that program 
evaluation is a powerful means to generate alterna- * 
tives for the improvement of Various program functions, 
including service to thfe target population. 




Obstacle Foujr - The program beingi evaluated v # t 

is .rarely a simple entity, ' 

• Although there are programs that are well defined 
and relatively unahariging/ f rom one setting to another, 
most community outreach programs tend 'to depend heavfly 
on the way staff members perceive ahd administer them.. 
Wide variations, can also occur in types- pf staff, their 
Skill**, sty le o ^acrvice. the amount of time thgy ^devbt^ 
to the prbgrW^^articipants' attei\da»ce, even the con- 
tent *nd basic direction of services provided. 



\ 1 ■ 

/The lSact is that community out reach* programs of t^en ^ 
include i> conglomeration of shifting $ctl4>i tibia that 
require t^uvrmous efforts to specify and describe. Nfew 
and innovative programs , part iculari ly, 'neecJje/tcF fumble 
around searching, £or a rationale, *\ strategy ,of action , 
ami procedures qf operation for quite Js'whj le before 
the 4 staf f settle on a course. Because of such 'ir\i tial . 

♦uncertainty, evaluation frpm th*e outset is sometirrtes 
premature. In those cases, it may be fetter £or tne 
evafuator" to wait until i r t la* clea.rWtiat the program* 
i&t' it is ra # ther eoihnion that pfogram evaluators heed 

..to- work with^tho project staff, in the rfeai^cft of the" 
program course at the very beginning ^stage of ,the pro- 

Soct. ^1 1 is paramount, therefore, for program evalua- 
tors not tp make prematuce judgment on the worth of 
ny community outreach prograih before its course is 
clearly formulated. 

\ Obstacle Five - it is diffica.lt to obtain 



control groups from the/tar- 
ge^ papulation as a basis font 
a comparison with the group o| 
people who has-been served py 
Che proc^ram. * ' 



v 



In the catfe. of community outreaQhf prog^ms, people 
usilally attend programs on a voluntary basis. Those 

To attend* tend to have a stronger motivation than 
thost*"who do not. Their progrSm performance sometimes 
ret' loots * the effect of motivation more than the effect 
of the program. Besides, it is almost impossible to 
Yandomly assign individuals into a specific program 
while at the sajne time to *have a comparable" group qf 
pieople. wflo jjtt v not in xhe program for, 'a compar i&grf* 
Since this .obsj-aclo seews %^ be inevitable 'in ; the case 
of .moctt community outreach programs, it is important 
for evaluators to inlYoducc safeguards through the : * 
careful use ixf evaluat ie>n^ designs , strategies, states*- 
ti'sal treatment, jind/or * follow-up study of participants/ 

to compensate for v^uch inadequacy (Weiss, 1^72) , tli 

\ ■ .* 

In actual situation,' one m^y'.find many more obsta- 
cles than what have' been presented ^ However , \heso 
five seem to be most, or i^rtal and pervasive, especially 
in the Case of commun i^^Qift reach, programs . The exafapj.* 
presented hyre^ifter hopefully provides some ideas o"h 
how sAme of these obstacles can be fully or partially 
overcome. 

■ * • 



v • * ^; a r — " . . y * * fc * 9" Con t r i bu t i nq Pa c tori ' 

~ , — _ r-. 

Pour practices have been found ih our project as' 
contributing to the ef f ect iveneaa of <mr program eval- 
uation. Each dt, those four fa.tori" ia . reviewed 'and 
v diaeuaaed briefly i r > this aeedLon. , 

\ • "*!5£^JiL«.^»2 _ The entire program evaluation . 

, of the project was a team effort 

of^the directory Staff, and the T 
i "eValuatot - * 

From the beginning ti 1 1 ^th* end, of . the project, the 
team (director, staVf, and evaluator) met together oh a 
regular basis. Por^he-first eix-months, the t*>am met 
fas often as ^wo to three limes, per Week and the length 

of each meeting trfiged from two to four hours. Such 
. «>««tinc,s helped: . (11 establish the necessary rapport - 
'C!'f T liUah revolved,. (2) decrease the discrepancy 
between'and among .members • perception and expectation 
of pro-am equation, and (3) crystallise the protect 
' goals and program objectives. <* i 

Factor -Two - Pre'-pianivihg ptrtor to^each group 
-evaluation merft ing by the project 
f director and tl e evaluator . • ., • 

n^n # H 9 1° tV ° i! aVs P 5 ior tQ the * scheduled group evalua- 
tion meeting the pr^ect , director an^eValuator panned 

.S!V ll , Zed the for the subsequent meeting. ± 

Background materials were reviewed v»nd discussed . Po-* 
t en tildl. problems were identified and various problem- 
solving ideas wer^analyzed and eva.luat.ed. The result 
was »0 sc^mb im^*<produetive group evaluation meetings. 

Lact g rjrgjteg - The project director had. a' strong 
commitment and belief in program 
evajuatsfon. « s 



Tfy level of her commitment was evident * in her re- 
cruitment ot«an external eJaluato^ the earliest 
possible statue of the project and in her openness in •', 
sharing- and-drscu*sing every maidt program decision \ 
# SI^h5S Ua ^°I" furthermore*,, she was willing and., 

capable of viewing project matters from both mafiaW ial 
and evaluative perspectives. ^Seldom an evahiatoAas 4 
the fortune to work with such ,a project director* \ 
- Evadors must work continuously on increasing tie* 
level of commitment by -the, project, directors to Sro, 
gram evaluation through gradually gaining* their cW 
i luonco. „ — % * 
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v Fact or four - Evaluation meetings were con- 
'7 (Tucted in a highly professional 

4 manner , ig.aue- rather tHan 

* personality-oriented. . . . 

. ■/ • * • ' ■ ' ' 

Dur4ftg our evaluation fneetin#s, dlasentirig Opinion 
was Usually' appreciated, though not always accepted. 
^Most importantly, disagreement almost ifever' ended with 
negative con front at ion. Braihstormirtg'se^slQiis were 
held Y„°J ia tant ly to generate ideas. Menders attending 
ejhh feting often had a senW of accomplishment when 
tney .left, Ttfis practice helped facilitate ineffec- 
tive participatory decision making prbqess. At the 
same tima> ft provided opportunities for multi-level . H . 
doirdmunication. 

program Evaluatio n Process 

(The complexity 6f a program *taay inf luenc^e ^thfe pace 
in which' progress is made but seldom cnimge the major ^ 
steps ; through which a program can be evaluated* TheV 
^five major steps ire program evaluation are discussed 
in sequence Vis fallowing: 



Step One *~ Ana lyze .project goals and prptjram 
objectives, p 

, 4'his st£p is'most essential because one of the 
major purposes of program evaluation is to .assess the 
extent to which project* 5 goals and objectives are ac- 
complished. 

Program goals are precise statements of the pro- 
ject's intended end results. These results, hopefully, 
parallel the* ultimate objectives of Extension programs. 
Objectives can be flans to utilise various kinds and 
amounts/ qj£ resource^ (iriputs ) Carry out certain 
planned program activities >*hoch involve people to *be 
served (target population) S Objectives can al^&o be m - 
intended outcomes indicated in the form o^: (1) r6-? 
actions of participants at^e^dipg various program 
act i'vi t ic/s , (2) change in pat* t i cipants ' knowledge, 
httitudes, skills, and/or aspirations ("KASA" change), 
and (3) application of acquired knowledge, attitudes, 
skills, and aspiration to work o»* 1 if e-s ty les 
(USDA, 1976) . ^ ^ 4 

The goals and objectives of a project should there- 
tore f^rm a hierarchy with a sequelTce for program eval- 
uation. Such a h ieraVchy ,' cons istent with the ^hauy of 
event% in Extension programs, provides a parametefrin 
whj^ch data-based program evaluation c^an be conducted. 
Such a hierarchy consists of seven levels: (1) the 
ultimate program goals,* (2) part icipants J^actice 
change, .(J) g^rt icip^nts KASA change, (4) v, participar^ts 
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reactions, (5) target population ipvolvement; * * 

(6) program activities, (7) inputs. that are neces- ' 
aary for the 'attainment of ultimate* program, goals . - 
• 'Figure 1 depicts, the hierarchy of goale and ob- 
jectives for. program evaluation, including evidence 
of attainment at each level. Decisions regarding the 
attainment levels 'desired by the project" director 
together wi^h the sVaff provide the basis for 
collecting' evaluative ^information. For example, if ' " 
the destred attainment* level is "input", the evalgu- 
ator needs to" make, evaluative judgment based on* 
information collected only on the kinds and amounts 
of resources that have been utilized* in the project. 
The more levels of attainment that are desired,- " 
therefore, the mone involved and complex the program 
evaluation process., The higher the level of attain- . 
ment, the n\pre riyordus and demanding ,the evaluation f 
means need tp-be. ' ' 4 ft 

iTiitia^ly, each program goal .must.be .analyzed 
individually. When .analyzing you should ask, "Can '• 
this be achieved?" If the answer. to tnis question 
is "No," the evaluator'has the responslbl llty • to 
discuss the reasons upon which such a concision is ' 
based. • At the same time recommendation can' also ^ 
be made lr> ^terms of what may be done to. increase 
the achievability &f the gbal and objective being- " 
analyzed while stil'l maintaining the .original intent 
and. rigor of .Che program. Usually, the more realistic • 
- lS ' tn ^^ et ter; chance it has to be accomplished" 

If -the answer to such a question is "fes," further 
quest ioqs must b6 asked. " 

"Isl.it clearly stated in measurable terms?" id, 
another important^' question e*aluatora7must as/wfren 
• each goal and objective is analyzed 1 .. The more pre- " 
'r*'^ 96 a "d concrete , the goal statement - is , ttie better 

r chance it has -to be evaluated objectively. fifte-n •' . * 
t . program y T ali, are stated in vague and general terms. 
• If so, the.evaluat^r has no choice) but tCbuse sub- 
jective rather -thSih .object ive means to assess the 
. .\ extent" 1 ,f 6 which jfhese ' goals aVe accomplished. Sub- 
J .jefttive assessment tends to allow too much room for 
*t Personal b^e-s, and misinterpretation., If possible, 
-therefore, the, evaluakor should help t*e project 
.director and staff formulate their program goals and. 
6b].ectives in concrete -and measurable terms. > - 

In ^dition to analyeing the achievability i?nd h 
measurabiUty of each goal- and objective, evaluatorsj 
3!l w ^ et ^ er or »V>'t all program .goals 'anal 

'S&f? ? k! 6 °? n » A »tent. Lack^of consistency among, 
goaip and objectives tends tb. generate conflicts lh 
management, delay, or hinder the. progress of the • 



87 w 



Figure V * ' 

HIERARCHY OF GOALS AftD OKJiCTLVSS FOR* 
PKflGRAM. -VAUATION AND LiVIDSNCK Of ATTAINMENT LEVELS 



Goals - End Results 




Reactions 



People, 
v Iffvolemont 



KASA 
Change 



Practice 
Change 



•Project M aide H effects 
and 

Social impact 



Application of acquired knowledge, 
attitudes, skills* And aspiration 
to work or life style 



Ghango in knowledge, attitudes, skills, 
anl aspirations 



Proportion of participants* interest in events and 
proportion jof participants showing acceptance of 
persons conducting events* (activities) 

Mumbor of participants -in varioq* events (activities) 



Paycholoftical 4 ^socioeconomic characteristics of target audience 
Continuity, frequency, and intensity of fate-to-face or mediated 
„ Activities jjint^action between target audience and prpject staff 



Planned stfutegief "in collecting and preparing educational materials 
Ti\Vfami ttin subject ^martter xofttont through- mass media , meetings, and 

author t;v»?nta -"V { ' i , . ^ 

Public i 2 inr' t programs 



Plnn:i Jto utiU#i* ! <trt !a and amounts 6f resources to* 
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Bvldortqe 
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implementation precast, and increase the cost of 
program offerings, tf inconsistency or discrepancy 
ijj found among program goals and objectives, im- 
mediate feedback must be provided to the project 
.^fiteetoi as well .as to the staff members. 

In our own project, analysis of qoals and objec- 
tives was carried out by a team including the evalu- 
ator, the project director, and one to two other 
staff members. Lengthy deliberation was usually 
given to each major goal and objective at the very 
beifinninq ot the project. We found that it was 
essential Jror all parties concerned to come to an 
agreement ftn the interpretation of a goal or ob- 
jective statement before, it can be opera t ional i zed 
i txto act ion . f 

Like moat Extension programs, our community out- 
leach programs have, explicitly or implicitly, pb- 
jectives at almost all levels of the hierarchy, as 
depicted in Figure 2. A selected list of our program 
objectives with indication of their hierarchical 
'levels are presented on the next page as an illustra- 
tion of the wide range of objectives included in a 
community outreach program. 

Step Two - Translate goals and objectives 
into measurable indicators 
(evidence) of levels of achieve- 
ment, 

, There are many factors which enter into value 
judgments of. programs. Generally, the more nearly 
the objectives of a program are reached, the more 
positive the judgment of the program, i.e., the 
higher the value assigned to the program. 

As outlined and illustrated in the previous step, 
most community-based programs have objectives at 
several •'or all levels of the hierarchy depicted in * 
Figure' I. Usually, evidence of program impact in \ 
the form of achievement indicators becomes stron^cf^ 
as onf goes up the hierarchy.' Indicators (evidence)' 
at the tw*' lowest levels; namely, "'•'Inputs" and 
"Act t vi ties, M provide little or no measure of the 
extent to wliieh target aud^irhco benefits from the 
program. Indicators (evidence) at the "People Involved 
level may'suggost the extent to which some kinds of 
benefits are being received by participants. However, 
evidence at this level, such as participation rate, 
does not necessarily indicate progress toward ultimate 
program objectives, A high participation rate may 
occur foy some reason unrelated to the benefits in- 
tended td accrue from the program, 

j * 
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Figure 2 ^ « 

SELECTED COMMUNITY OUTREACH PROGRAM OBJECTIVES j 
AS EXAMPLES IN VARIOUS HIERARCHICAL LEVELS 



Hierarchical Level 
End Results and Activities 



/ 



People Involvement , 
KASA Change, and 
Practice Change 



Objective Statement * 

"To raise the Levil 'of 
living for individual^* and 
families in three Middlesex 
County communitidfc (ar^d 
vicinity) while d^/eldping 
an educational package! in 
family resource management 
fpr Extension profession- 
als," J \ 

•'Low an<J middle-income 1 « 
families in the thx^ee 1 
communities in Middlesex 
County will learn and use 
skills to develop a per- 
sonal money management 
plan recognizing that 
periodic revision is 
required due to changes 
in the li fe cycle. 

"The community outreach 
phase will utilize a 
mobile van, ^community / 
meeting ro&ms, and other 
locations. Mini-les&bjns „ 
will be given and courses 
will be held at religious * 
centers, at industrial 
sites, as well ( as in homes 
r bringing .valuable informa- 
tion concerning budgeting, 
- credit , insurance, and 
saving to those who wish 
to participate, " 

♦Quoted from the original funded proposal of our 
outreach project. ^ 



Inputs and Activities 
Ptiople Involvement • 
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Evidence at the "Relictions" level can start to 
provide better indication of whether qiven activities 
are helpful as intended. However, such evidence in- 
dicates less satisfactorily than evidence of KASA 
ehanqes. the extent of proqiess toward ultimate proqram 
objectives, Knowledqe, attitudes, skills, and aspira- 
tions to be acquired arc often considered as merely 
preliminary straps' to adoption of more desirable pat- 
terns of behavior, though there are difterinq phi I ok- 
ophios cmi whether practice chanqe is essential to 
successful Kxtension anil community-based education 
(Steele, 1972) . 

Practice chanqe assessment is considered desirable 
by many education evaluafors when proqram objectives 
involve indicators such as: (1) expression of ehanqed 
attitudes; (2) utilization or application of new 
knowledqe and/or skills; ami (?) f o 1 1 ow- t hrouqh on 
new aspirations, decisions, or commitments. 

Assessing practice chanqe is, however, quite dif- 
ferent from assess mq accompl i shment of ultimate pro- 
<|t im objectives. Extension workers are often held 
accountable for the extent to.whieh their programs 
are cont r ibut fnq to the solution of overall problems 
of their turqet population or the society in which 
they serve. Hence, riqorous evaluation of the impact 
of most community-based Extension proqrams would 
probably be in terms of whether desired end results 
are achieved, mcludiirq assessment of any siqnificant 
side effects. 

Usually, the strenqth and riqor of proqram evalu- 
ations can be enhanced by assessinq at as many and 
...as luqh levels of the hierarchy as possible. But the 
difficulty ami. cost of obtaining evidence on proqram 
necomp I i shment s tend to also increase when the 'number 
of assessment levels is q renter and the hierarchy of 
proqram objectives is asce'tuied. • ,» 

The most important task at this poTnTof t h» pro- 
gram evaluation process is, therefore, to delineate a 
set of acceptable indicators closely reflect inq • the 
level of accomplishment that is des i rod for each pro- 
qram objective. Such indicators become the basis upon 
which devices and strateqies for collecting evaluative 
information (evidence) can bo des lq ned and developed 
These indicators usually reflect t he. ob ject i ves of and 
learning expectancies for c arh of the major topic areas. 
In addition, they provide a quide to insure that the 
presentation of the topics is consistent with the 
ob HH'tives. 
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The delineation of indicators for each topic area 
l an involved and systematized process that involves 
six sequential tasks: 



TasK One - Defining the hierarchical levels 
of specific objective's for- the 
topic area consistent with the 
ne<*ds of the commun i t iqp , goals 

| of the project, and time limita- 

/ t ions of the sessions. 

Task Two - Developing content outlines of the 
subject matter based on the ob- 
jectives defined. 

These f i rst two tasks are carried 
out by the pro ject cfi rector , pro- 
gram assistant, and /or subject 
ma 1 1 er spec i a I i s ts 

Task Three - Drafting a suggested list of indicators 
* relative to the objectives and content 
out'l i nes . 

^ Since the 1 indicators are used by the 

^ project staff as a guide and by the 

evaluation staff as a basis for 
determining if the clientele ac- 
qu i red competence and practice change, 
the Uraf t ing is done joint ly ' by the 
project director*, program assistant, 
and evaluator, and/or the evaluator's 
assistant. 

t» 

Task Four - Modifying And revising the draft as 
i nput , comment , and sugges t i ons are 
ma de by membe rs of the staff- 

Task Five Delineating topic indicators by 

1 consensus at a joint staff meeting. 

Task Six - Testing and refining indicators in 
^ tight of t he i r use by the pro ] ect 
and ova luat ion staffs, taking into 
account c I iente le f eedback . This 
j procedure allows for the benefits of 

e x pe r i e n ce to be in co r po rated into • t h e . 
project . 
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Tht oinjh the use of the aho*v process ,* f i vo sets of 
UHlu-.itors were delineated in the i-ontont areas of: 
!!! V'V i,U ' UM k)l,di J*'tuKj, O) savimr .tml investing, 
(•») 111." insuraneo, ami. ( r >) housinq. A copy of the 
:ilx I'ulu-.itors toi. the topic on luuhjetiiuj is qiven 
as .in example on/the m<xt paqe. Notice that t ho 
,l '" i|,,,fl hieiaivhkc.il U<vvl of .it t .1 1 nment is "Praet iet?- 
1 h.in-ie" on this se\ ot 1 ml i 1 '.it 01 s . ' • 

Kurt hei nioro, the project and evaluation staffs 
haw intent lonal l Y dewlop.nl all six indicators cm 

topic as criteria tor the assessment of KASA 
^hanqes rat hot- than for the evaluation of program 
aetivities. This was clone due to the faet that each 
topic area was usually presented by different individ- 
uals m a variety of settinqs for various types of 
audiences. There was a felt need to allow the flex- 
ibility to accommodate and encouraqe a wide possible 
t "He id instructional stratoqies to be used. 



kNl) I ^TOHSJ'(iR m top I C : lUipr.KT I Nr. 

The following six indicators have been identified 
tor the topic on budqotinq. At t he end of a sessi 
on'budqot mq, the participant will be able t< 



i on 
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1 ' ^'ti'io a budqet plan as a workable guideline 
tor spendmq which varies from person to 
pe i son . 

explain that the puroo.se of setHncj up a 
budqe.t plan is to meet' Individual and/or 
t ami 1 y qua I s and need*? . 
** • , r 

*. identity the important factors in sotting 
up and in mod 1 f y i nq\i budqet plan winch 
are: 

- \ neome 

- dob> 

family size and composition 

- value system (qoals, objectives, priorities) 

i^ntify the key elements of a bifdcfet plan which 
are: 

- 1 ne^me (s) * ' 

- expenditures (fixed and flexible) 
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- saving and investment 



5. name the steps of setting up a budget plan 
including : 

( 1) ident i f ying take-home incomes , 

(2) identifying obligations, 

( 3) computing expendable income, 

(4) budgeting expenditures in each 
area of needs', 

( r ) keeping record of spending, 

(6) comparing actual expenses with 
allotted amount, and 

(7) adjusting the budget plan based on 
. changing situations in the family. 

6. apply knowledge in setting up a budget plan 
by using a case situation provided by the 
presenter. 



Step Three * - Collect data pn the indicators 
for participants. \ , \, 

Evidence of accomplishment of objectives may 
vary in quality. The range in quality of evidence 
•is often referred to as "hard" or "objective" versus 
."soft" or "subjective data. Data are "hrfrd" to the 
extent that they.aYe valid, representative, and 
quantified (Sjogren, 19*70). One must realize that 
so-called "hard", and "soft" data constitute a con- 
tinuum; a dichotomy is depicted simply for the sake 
of convenience. Hard data are usually fdeal and 
preferred; however, they are usually more expensive 
and difficult to obtain. Hence, they should be 
collected only when the benefits to decision- 
making anticipated from superior eVicIence. clear ly 
outweigh the cpsts of obtaining such evidence. 

There are many situations especially in the con- 
text of community outreach programs where "soft" data 
are all that can be obtained. For example, program 
participants, and particularly nonpar ticipants , are 
of ter> unwilling or unable to be observed or to respond 
to instruments which require detailed answers and ex- 
tensive time for completion. 




Be careful &bout the validity of the data gathered. 
For example, awareness of program evaluation by par- 
ticipants may cause them to "act or' speak the way they 
think they are expected rather than naturally. Data 
invalidity may also result from faulty instruments , 
from observing too 'small *a ranqe olf actions, and/or 
from perceiving participants' actions inaccurately due 
to personal blast.- 

In addition to- validity, the preciseness of the 
*data in pfovi\iing an adetfuate picture of the partici- 
pants is also critical. Thus, Ait is important to 
obtain quantitative data capable of describing and 
indicating rather precisely the deqree of difference, 
commonality, or re iat ionsh ip 4 between and among program 
offerings, clientele groups, individuals, or structures 
that arc being observed. 

Representativert^s is a third area of concern re- ■ 
garding data quality]. Representativeness is the extent 
to which observations concerning individuals, groups, 
or situations under study apply to a* total population 
of .individuals or groups. It can be achieved through 
taking a census of the population or taking a repre- 
sentative sample from the population (Kish, 1953). 
In the case of eonununity outreach programs, it is 
difficult to achieve high degree of representation 
when data ate collected. * This is due mainly to the 
f a c that part xc i nt« a * t^nd - pT4*g*-eMRs - -on* * « ■ vt? 1 un^a^y — 
and on-and-off basis. 



Data collection planning requires four types of 
decisions; (I) What type of data is needed? 
(2) Who will collect the data? (3) How to collect 
the data*? and (4)> When to collect the data? 

Iji our project , a worksheet vfan used to plan our 
data collection strategies and means for the ^ntir.e 
project. The evaluator first prepared a tentative 
.plan ahead of time, using the worksheet provided on 
the next page. This plan was presented to ap/fl dif^ > < 
cussed by, the entire staff during one of the evalua- 
tion meetings'. Thereafter, the plan was revised and 
used as aj-qntde for f urther ing , moS t , if not all, the 
evaluative efforts, in the project. 
* • 

As soon.aa a data collection pla'n is made, appro- 
priate data collection devices and strategies need to * 
be selected or developed for each type of data ntfede*. 
Numerous kinds tff information gathering technigues are 
available from which one can select as means tp- collect 
evaluation .data. Whether the devices are selected or 
tfevelop^d, four criteria should be used: (1) validity, 
v(2) reliability, (3) objectivity, and (4) feasibility. 
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COMMUNITY OUTIUACH PRQT.RAM DATA COLLSOTIOMJgLANNlNQ SHEST 



,<hat type, of *lat*Ms noodi 



I . Input;; 

i * Human 

t • Mat* rfal — — 



IT. Procunu * 
a. Activities 
V formal Topic Group - 
. -jtomu^j'tucly Course — 

, " • ' * Lunch % Loam 

Othur — r 



III. Outcomes * 

a . People Involvement - 

b\ Reactions ; - 

c* KA3A Changes — * 

Practice Change — 

Impact 
a. Social — — 

V. -Budgetary Concern , 
0* Coat-Dertof it • — 

EMC 




1L 



z 



9 



A- 



A. 



X I A. 



< 
4. 



-A. 



A 



* 

A., 



4 J 

™ N py* ■■ ** 



.A 



A. 
A. 



The validity of a data collection device is most 
important. Without validity, it* is almost worthless. 
The level of re 1 i ab 1 1 i t y k of a data collection instru- 
ment can usually bo determined through statistical 
analysis (Thorndike and Hagan, 1961). In reality, 
the, degree ot validity, reliability, and objectivity 
of. any set of data collected depends highly up6n the 
trade-offs between "Uleal measurements for t)\o evalua- 
tion purpose <:\t hand and the feasibility of the data 
collection strategies and devices to be utfed. ° 

* 

In our project, we have found that early timing 
in planning allows the' project and evaluation stiffs 
to make informed and » systematized rather than hasty, 
last -minut^ decisions. Like any other steps of pro- 
gram Evaluation, sufficient time i* essential to have 
the job dojie \£oll. Following is a variety of data 
collection instruments developed and used in our 
pr*>1oet together with their admi n i s t rat ion* strategies 

y ■ 




PARTICIPANT RECORD FORM* 



NAME i 



MAILING 
ADDRESS? : 



PLACE: 



' *Mea»e Pcint 



T 



TOPIC: (Please check) 

* 



Credit^ ' 
_\ Saving/investment 



PHONE : 



ZIP: 



DATE \ 



Budgeting/Family Communication 
Insurance 
Housing 



*TJ\is/?orm is completed by the clientele and is . 
designed to collect data ae a basis for con- 
ducting process (activity) and product (number 
ary:l type of clientele) evaluation, it provides 
4m«?ans for obtaining the clientele sampl^ for 
product (outcome - KASA change) and impact evalu 
' at ion* 
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QUESTIONNAIRE 

r • 

This device, completed by* part icipants , is for the 
purpose of collecting dafea for evaluating process N 
(presentation of information and materials) and product 
(clientele reactions) • 

To the projecjt staff, this questionnaire provides 
continuous participant feedback which reinforces th$ 
existing strategy anchor suggests changes for improve- 
men t . • 



CONSUMER PROTECTION LAWS QUESTIONNAIRE 

This questionnaire, completed by participants, is 
designed to. collect tJata for evaluating process 
(presentation of information and materials) and products 
(outcomes - KASA change and reactions). It hate been 
used" specifically with senior citizen groups*. ; 

; The , questionnaire also provides participant feed- 
back to the pjpoject staff which reinforces the.exist-^ 
ing strategy and/or suggests -need for program improve- 
men t • * 



INSTALLMENT LOAN' WORKSHEET 

■ • * ■ - * - ' - " ' f 

The worksheet, completed by participants as an ex- 
ercise during the presentation, gives evidence of 
'product (KASA change) evaluation. 1 



\ 
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1 OUKSTrONNAlRK 

Ovele the number bo- 
low thrft best describe*! 
t he aoMrt i on in i e I a t ion 
t o your expoetat ions 
about it: • * 



"Tor ftrrice t)s 
Topic; 



DrttO! 




Place: 

Presenter (») 



1 J J 4 



X 6 



,7 H l > 



CiOod 



Won lil you nvoommend this session to your friends? 



Yes 



No . 



. ^ List what *Vou 4 iked and didn't like about t he 
I liked: ; ; * ' 



I didn't 1 ike: 



4. What subjections do you 1 wive for the improvement 
ot t he robs ion? 



v ^ Would^you like jo attend further 



soss ions on : 



Ci ed i t 
^ ihnis l IH] 
MiK»K?et nuy 



x L i fo I nsuranee 
__ _Saviru| and lowest I ru? # 
__0 1 h e r ( s u qc| e s t ed topic) 



THANK YOU 
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QUESTIONNAIRE 



For Office Use 



foplct' Conamr. frrot. LSvs 

Date: ' ■ 

Place: 



Presenter : 



This session was abouj: your rights in dealing with 
Uoof-to-door spi ling, products mailed to%you thafyou 
did not order, and product warranties, 1 To help improve 
our service, please answer any or all ofc- the questions 
, below, # 

Circle t)ie nomber below which tells how yoju feel abou€ 
the scasio-n : 



Nothing /• A lot 



\ 



1. How much did. you learn? 1 2 3 4 5 6 } 8 9 10 * 

• * * Very 

Not helpful helpful 

2;- Was the session helpful? 1 2 3 '4 5 6 7 8 9 10 



x 3, Would you recommend^ the session* to your friends? 





- Yes « No 


Please tell what you 


liked or didn't like about*, 


the session. 










^ — ^ » — ' • — 

- — : ■ — - - - — - 
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SJ000.00 Installment Loan 



APR 



a) Amount to be. financed 

b) Finance charge 

C) Total payment ' 

d) Annual percent rate (APR) 

e) Payment schedule ( % 



Monthly payments of 
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SESSION EVALUATION 



This form is completed by a member of the evaluat/ 
staff or a nonparticipant observer at a session. To 
the evaluation staff, this provides data on process 
(service delivery system, presentation of information, 
use of relevant materials,, feedback to the project 
staff) and product , (recipient profile) evaluation, . 

The importance of having this type bf information 
became apparent to the assistant evaluator after 
observing several sessions. No two sessions even on 
t$e same topic are exactly the same since the pre- 
sentation ia'geared to the characteristics and needs 
of the cli-tentele group. Thus, the evaluation staff 
needed to have a record of the items discussed and the 
approximate time spent on eadh -so that the follow-up 
interview questions would correspond to the presenta- 
tion. Further, it is valuable for the evaluator to 
know whether* the clientele from a particular group 
could be used as part of the /follow-up interview 
•evaluation. The use of the form to evaluate the 
presentation provides another avenue for communicaVion 
and feedback, between the two staffs. 



J 
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.l^MMilON 8VALUATION 



I. Item* Di*cu**ed 



Tim* 



Top 1 c i 

. D*t*» 1 ._ 

Preavnter t 

Place i 
Contact i 
• Participant*! 
Eva 1 viator i . 







1*1 . ' Hapdout* U»e\i 

\ 

Participation 
Fo rm 



Quest lonnai re 



III. EVALUATION 

Rapport * 

Time** 
Manav)#>Wr\t, 

U»e of 
Handout a 

Motivate* 
Audience 

Appropr late 
Mater iaf 

ht feet i vjb 
PrypMonta't ion 

IV. Audience for 
Feedback * 



Poor 



* Good Ap 

V 4*678 



p* 



t 2 J 4 S (. 7 8 
1 \ 4 5 6 7 8 

t i- -3 4 5 *6 7 8 
} 2 J 4 5 6 7 * 
1^345678 
2 3 ,4 "5 6 7 8 



Comment* 



V. Other Comment* and Suqqent ion* 
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^ CONSUMER INFORMATION CHECKLIST 

• • • 

9enta P f^° U ; l I discussed forms dealt wittf the* pre- 
' An^h k 9essl °ns outreach phase of the protect 

Tn <- S .f SK'?' outreach ™ ^e use of a mobUe 
* ^' $ Mobile.-. ,The van serves three taraet 
communities, dispensing information' anTmaterta Is . 

who 2 l AiT ^iKii'^M^i'i^ 1 '*?^ 



-1 i*/^'- 



105 



W. L I, COME TO $ MOBILE 
Consumer Information Checklist 



To help wnprove ^>ur service, please circle the* appropriate numbers 
which best indicate your keelinq^>r experience about the materials 
you h.4V<t selected. 



MATERIAL 



BAtf 



DID 
NOT 
GOOD READ 



Undei st and itu'j Lite Insurance ( 383). 


I 2 * 


3 


4 

• 


5 


6. 


7 


8 


How Much Am I Wortji? (4 76-A) . „ . . . 


1 2 


3 


« 

4 


5 


•6 


7 


• 

8 


PiAHjranwiirui My $'s (477) 


1 2 


3 


4 

* 


5 


6 


7" 


8 


Wha^ About Car Insurance? (480) . . 


I 2 


3 


4 


'5 


6 


1 


8 


Cat Loans ^48 1) . . . . ^ . . i*. 


1 2 


3 


« 

4 


5 


6 


♦ 7 


8 


Buy MU| A Car {$8 2) 


1 2 


3 


4 


5 


6 


7 ; 


8 


Dollars i^cVnts of Buying A 

House ( 48b- A) . . .' . . \ 

1 


1 2 


3 


4 ' 


.5 


6 


7 - 


8 


ABC 1 s o t Mo r t vl at j e Loa n s 

1 nsurance (4 88-A)* ' 


L 2 


3 


4 


5 


6 


7 


8 



Money Matters 
(48 7- A) . . . 



Wflmen and Credit 



Money Masters - Your Credit 
> Hiijhts (489) 



Money Ma t t e r s 
Job (S21) . . 



When You Lose Your* 



Projection Through Life Insurance" 
Food N Nut t i t ion • 



Kxt ens l on Home Economics . 



5 3/4 



3 

3 
3 
3 
3 



2 
2 
2 
2 



5 



5 
5 
5 



6 
6 
6 
6 



The following information would be grbatly appreciated: 
NAMK; ' DATE: ' 



Aonufess 



PHONE: 
ZIP : 

4 
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* * • * 

Ail of the aforementioned instruments for data 
collection benefit both theSt?va 1 uat ion sta.t f and the* 
project staff, tlcivitu) 'the instruments, meet tlu> needs 
of bobh staffs was a prime consideration.- The piHiW^i^ 
for their des.itjn and development followed procedure*! 
similar to the ones described tor the delineation 
of indicators. No instrument was used until the pro- 
ject director, coordinator," eva 1 uutor, *md assistant 
evaluator acjriHMl to i tallies u T n . if at tor us inu. an 
instrument a staff felt that it was not fleeting ' 

the objeCtiVey or detected any other problqms With i Us 
use, changes and improvements were suqqoHt cd and aqain 
agreed upon ^>y genera 1 consensus. * 

To toster oolranun leat i on between Uie evaluation 
stat # t and the project* staff, various channels are 
ut i \ i /.ed : v 



I. The project director and eva 1 uat or mvot 
regularly on a monthly basis. 

The project d i rec t oiV eva 1 u?i{ o r , coordinator, ^ 
■ and assistant evaluator meet montl'ly, general 1^ 
atter the d i rector-ova 1 uat or meofinq. " 

*. The evaluator and ass is t an l evaluator meet 
on »a week ly has is . 
* 

4. ^rhe project coord i nSvfcor and/or d i rect oi; meet ^ k 
with the assistant evaluator wileWy. * \ 

* 

r >. Other meetinqs between any members of the twn 
staffs are held whenever necessary. 

0- Memos and lettvrs are used arf needed. 

7. Telephone communication is* frequent. > 



The data «co i leet i on instruments are filed 
and available to all "members* of each'sbaft 



> s f£iL^l?I - Analyze and interpret evaluaj^wn results. 

Sr °£_i^V v ^ " Mjko and prosoht wduatiVe judgment 
find recOrmiuMulat i ons . ♦ - 



/ 
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These two step* of the -program 'evaluation process' * 
>sjfe discussed together briefly in this section due to 

two factors: (1) they are almost inseparable in 
practice, (2) they are highly technical and-.can riot " 

be covered sufficiently in this manual. Therefore, 

only general guidelines are provided. \ 

The main purpose for analyzing and interpreting 
evaluation results is to detect possible .relationships, 
trends', uniqueness, commonalities among program of- 
ferings, clientele groups, and/or individual partici- 
pants. Generally speaking, descriptive statistics. " 
(range, mean, mode, ... etc . ) are the mo&t appropriate 
way .to organize and simplify raw data into a. manageable 
and meaningful condition (Rosenberg , 1968) . , Inferential 
statistics, such as hypothesis testing', are necessary 

lf scientific inferences need t»o be. drawn (Winer, V 

Evaluations of program effectiveness are* utilised 
mpst fully if their implications .for decision making 
are noted explicitly. Presentation of evaluation 
results, therefore, needs to include alternatives 
and recommendations for future' program development. 
Furthermore, interpretation of evaluation findings " * 
for decision making -should include 'appraisals of the 
quality and completeness of the evaluation study.. 

■ Thte collection, analysis, and use"of evidence in 
judging^ the. degree of. program effectiveness should 
itself be assessed for, effectiveness .' If 'the ac- 
quisition and use of evidence on program impact is 
viewed as an "activity" through "inputs," then at 
least two questions, based on the hierarchy for 
'evaluation presented in ^his chapter, need to be • 
asked. These two questions are: (1) What has" been 
leajned by the collection and analysi-s of data, in 
relation to the degree of expected improvement in 
knowledge about program effectiveness? (2) Have 
program decisions been influenced by knowledge of 1 * 
program effectiveness acquired through evaluation 
studies? ^- . •* 

■* • 

v ^Finally, appraisals of evaluation studies can 
suggest needs for further program evaluation, or * 
re l^tec^ analyses, to assist in specific ^decision • 
issues wtthm the Broad context of program development. 
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, Sunuriary and Conclusions 4 . , ■ * r 

The major purpose of evaluation is to *^st in 
proqtam decision making. . Formal evaluations Are. worth 
doin$ only i*f they have-a cbance of affecting such . * 

■ .This ahapter pf'elTe'nts information and, cation* ^ 
relative tort (1) functions of program eyaluatiorr, 
\^ (2) obstacles 6f pro^r&m eva luat ion , * ( 3) factor** 
. effecting program evelya^ion, and (4) p$<5cess Vof ; 
evalUat ing .cdmmun i ty-based educational programs. ** "v" 
Examples from a federal-funded Community outreach 

• project- are provided to illustrate major points fceinu 
* -made. • ' , : 

• ' It was found through reading and practice in the 

• .field Ahati adequate judgments of program value ari£ 

souml program planning decisions can be made only by , g 
ramping clear criteria and sufficient .evidence 
regarding program accomplishments. ' ., ' v 
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